The Spain international has admitted that he was just one of a number of disillusioned players at the Santiago Bernabeu last term
The Spain international left los Blancos for Napoli during the summer after failing to nail down a regular starting berth under the Portuguese coach.
However, Albiol has explained that he was not the only disillusioned player within the Madrid dressing room last season.
"It was hard to keep the peace," the defender told Tiki Taka. "We weren't achieving our objectives and we knew Mourinho wasn't going to stay.
"Some of us had confrontations and the best thing was for the season to end, for another one to begin and everyone could make their own decision.
"I had to make a decision and I wanted a change, because I wasn't enjoying myself on the pitch; I wasn't playing enough."
Last season Madrid were beaten by Borussia Dortmund in the semi-finals of the Champions League, while they finished second in la Liga, 15 points behind champions Barcelona.