Coleman and the Football Association of Wales (FAW) had asked current international players to not play for Stuart Pearce’s team this summer, but Joe Allen, Aaron Ramsey, Neil Taylor and Craig Bellamy have all been included.
Although irritated by their decisions, Coleman added he will not be telling them they cannot play for Wales again due to their desire to play, conceding they do not have enough players available to be so firm.
He told reporters: "There almost seems there's been a little conspiracy to try to get some of our players to be negative towards the FAW saying this, that and the other. But there is no dramas.
"Ideally our boys wouldn't be going, they'd be resting. But they've gone, there's nothing we can do. There was nothing we could have done at the start.
"We've never changed our stance. I have spoken with the players, they know my feelings.
"There's no way I was going to say to the players 'if you go to play for Team GB, I'm not picking you'.
"We don't have a big enough pool of players to be that feisty and it's not the right way to do things anyway.
"I respect all the guys that want to play. It doesn't mean I have to like it because I've got to do what's right for Wales."
|GOING FOR GOLD
|11/10||Team GB are 11/10 with Sportingbet to top Group A at the 2012 Olympic Games|
Gareth Bale would have likely been a fifth current Wales international involved in the squad had he not picked up a back injury, and Coleman believes his missing out will be a blessing in disguise.
He continued: "He's played a lot of football and there's a lot of pressure on him when he takes the field.
"I don't want anyone to think I'm being disrespectful but I was quiet relieved that he wasn't involved with the GB team because that could have meant six more games and more training.
"I just think Gareth could do with a rest, mentally and physically."