The former Real Madrid president has criticised the attitudes of the pair and slammed the strong relationship his replacement has with the media
The 61-year-old left his post at Madrid in 2009 and was replaced by assistant Vicente Boluda, before Perez was later installed as his long-term successor.
But despite having severed his ties with the club over three years ago, he has been quick to give his opinion on a number of different incidents involving Los Blancos in recent months.
"I know many people inside the club [who say] that Mourinho and [agent Jorge] Mendes act as if the club belongs to them," he told Al-Watan.
"The problem comes from the strange silence of Florentino Perez, that is what really bothers me."
Calderon, who now works as a lawyer, then expanded on his apparent dislike for Perez and suggested his popularity is a result of his close relationship with the Spanish media.
"Mourinho or the players can be [criticised], but Florentino's strong relationships with the media prevents him from being criticised," he added.
"There are a number of journalists who have lost their jobs because Florentino Perez was attacked."
He concluded by giving his thoughts on the recent furore surrounding Cristiano Ronaldo's unhappiness at the club and advised the Portuguese international to concentrate on football.
"Cristiano, like all other human beings, is exposed to all kinds of feelings and sensations," he explained.
"Because of the comments he made to the press, everything is amplified.
"Why is he sad? The reason is unknown to me, but the important thing [for him] is playing well and scoring goals."