The Three Lions finished second in Group G, beating Tunisia and Panama, but losing to Belgium, and many have speculated that their finish actually leaves them with an easier route through the tournament.
And Merson insists that they provide very little threat to England's dreams of winning the tournament in Russia.
"I watched Colombia the other day and there's nothing to be scared of there for England," he told Sky Sports.
"They are dangerous at set plays but we are as good as anybody at set plays. I was sat there watching the Belgium game saying please don't score!
"If we don't get to the last four I'd be shocked. At the start of the tournament, we were saying that if we'd get past the quarter-finals it'd be great but if we don't get to a semi-final now it won't have been a very good tournament."
Despite Merson's ebullience, he has backed Brazil to win the tournament, despite the Samba stars facing a tricky last 16 encounter against Germany's conquerors, Mexico.
"I've always said we've had a chance but at the moment I can't see past Brazil," he added.
"However, from here if we don't reach the semi-finals you have to class it as disappointing. The route we've got now is Colombia, who have been poor and had James Rodriguez limp out of the Senegal game.
"Then it's Sweden or Switzerland. No disrespect to the two countries but if you can't beat them you are not winning World Cups."