The 26-year-old was due to sign for the Magpies during the last transfer window but instead joined QPR after being offered improved terms by the London club.
And Pardew believes his side's season could have been very different had the striker joined the French contingent at Newcastle.
|PREMIER LEAGUE PREVIEW
|30/1||Loic Remy is 30/1 with bet365 in a Newcastle win over QPR
"The fact that we lost out on Remy was a major blow to our season. We lost our main goalscorer in Demba Ba and he was our replacement.
"We felt he was going to sign for us and then at the last minute, he changed his mind, and that was a particular blow to us because it's very difficult to get a striker in that window.
"It's put extra pressure on us that he didn't arrive, so for that reason, I was disappointed."
Pardew was relieved when the Magpies' survival hopes received a welcome boost as Wigan lost 3-2 at home to Swansea on Tuesday, but the 51-year-old says his side still need to focus on winning their last two matches.
"It's difficult. You don't want to wish bad on your fellow professionals, but obviously we wanted the result to go the way it did, so that helped," Pardew added.
"I did watch it, and I had some sympathy for [Wigan boss] Roberto [Martinez] in terms of picking up injuries in the game. He has got the cup final tomorrow and we certainly all here wish him the very, very best in that game.
"But it's just unfair for us to talk about Wigan, it's more about us. We have still got six points to play for - we think they are two games we can win."