Like it or not, optics matter in football, and Potter never looked like a Chelsea manager.
This is a club whose most-revered coach is Jose Mourinho - master of media mind games and tactical pragmatism. The Blues' post-Abramovich-takeover identity has been that of ruthless winners. The football and people's feelings are secondary, all that matters is results.
That is what made Antonio Conte such a perfect fit - for one season at least - and made Maurizio Sarri stick out like a sore thumb.
Although Boehly had seemed to be taking a different tact, hiring a young, modern coach and largely signing players for the future, in the end, he could not turn the tide of a fanbase that has gorged on success for close to two decades.
'Mr Nice Guy' Potter attracted the ire of fans for his upbeat positive press conferences throughout his reign. He was always quick to insist "the boys gave everything today", even after an embarrassing defeat, and his much-maligned mention of that most-debated of metrics, 'xG', following his side's defeat to Villa was a fitting parting comment.
His cool-as-ice touchline persona wasn't much appreciated either. So much so that he even had to defend himself, using a rather odd analogy.
“This isn’t actually me all the time,” he said before his side's embarrassing 4-0 defeat to Manchester City in the FA Cup. “Of course there are times where you get angry.” He looked down at the table and picked up a can of water before adding: “It’s not like I’m some robot just speaking to this can all the time.”
"I’ve got to answer them as best as I can and respectfully as I can because I represent a fantastic football club," he continued. "I’ve got that job to do regardless of if I’m p*ssed off after a game. I have to come here and represent Chelsea in the best way."
Potter may have thought he was being true to himself by handling questions respectfully, but it was out of step with what onlookers associated with a successful Chelsea manager.