The former Blues forward failed to break into the first team and, after a series of loan deals, joined Swansea in August 2010.
Now, having established a first-team place with the Swans, the 22-year-old believes it was the right decision.
"I did have to take a financial hit when I left Chelsea, but sometimes you have to take a drop in wages to get the opportunity of playing regular football," he said, according to the Daily Mirror.
"Chelsea couldn’t provide that. It’s why I left. People could say it was a gamble, but at the age of 21, I wanted to be playing week in, week out and I felt like I was hitting a brick wall.
"I went on loan a number of times and every time [he went back to Chelsea], I thought I would play. But there are so many world-class players in front of you at a big club like Chelsea then it can take years to break through. It was really frustrating.
"I had no doubts about my ability, but knew I needed to establish myself.
"Swansea was a fresh start and it’s been great to have a manager who has believed in me. I knew I’d be back in the Premier League again."
The former England under-21 international is eager to face his former team to show Andre Villas-Boas' side the progress he has made.
"It’s great when you are 18 or 19 and around the Premier League champions or FA Cup winners, but you don’t really feel part of it unless you play," he said.
"If I wasn’t at Chelsea, I wouldn’t have got that feeling. I’m not bitter and don’t hold grudges, but I’d say I have a point to prove. It would be great if I can score and the team gets a result."