The Argentine has slammed the current Chelsea manager for ignoring him during their time alongside one another at the Santiago Bernabeu
The 58-year-old Argentine was forced out of the Santiago Bernabeu in the summer of 2011 because of his troubled relationship with the current Chelsea manager and he has few good memories of his collaboration with Liga-winning coach.
"Jose Mourinho was always imagining things that weren't there," Valdano told El Hormiguero.
"I was not someone who blindly followed what he said. I was always willing to talk with him, but he systematically refused to talk to me.
"If it was up to Florentino Perez, I would have stayed at Madrid."
Valdano then went on to compare Mourinho to Pep Guardiola and stressed that the current Bayern Munich coach is much more of a football enthusiast.
"Guardiola is someone who has a passion for football. Mourinho only has a passion for the final result."
Mourinho spent three seasons at Madrid, winning the title in 2011-12 only to part company with the club in acrimonious circumstances the following summer after some high-profile dust-ups with senior players.