The 21-year-old completed the scoring in the Reds’ 2-0 win at Stamford Bridge on Tuesday, a victory which sees them into the semi-finals of the League Cup.
The right-back says he was delighted to open his account for the club, made all the more special for it being in front of the travelling Liverpool contingent.
The England under-21 international told the club’s official website: "I was made up with the goal and it was a long time coming getting my first one for Liverpool.
"It was a great cross from Craig [Bellamy] and I managed to get a free header. We were attacking at the end with all the away supporters and it was brilliant seeing all their emotions as they celebrated. It's fantastic to get a goal for such a big club.
"I scored a couple of goals for the England U21s recently and it was great to score against Chelsea and help us reach the semi-final of the Carling Cup.
"We have beaten Chelsea twice now in the space of a few weeks and it was a great team effort out there.
"We definitely deserved to win. With the possession we had in the first half, we knew the goal was coming and we are delighted to get the victory."
Liverpool’s win over Chelsea sees them just two games away from the final, and Kelly confesses it would be a dream come true to play at Wembley.
He continued: "We're looking forward to the semi-finals and hopefully getting to the final at Wembley.
"If you ask any young lad, they dream of one day playing in a final at Wembley and I'm no different.
"I can't wait for the next round and hopefully I'll be a part of that."