The centre-back played 90 minutes of the heavy loss at White Hart Lane in a third-round League Cup tie in 2010.
And Caulker, who scored his first goal for England in midweek, is relishing his first ever Premier League north London derby after stepping up to the Tottenham first team this season.
"It will be very surreal knowing that in the space of two years I will be playing them again in a Tottenham shirt in a league game," he told Spurs TV Online.
ARSENAL V SPURS PREVIEW
Arsenal and Tottenham are 11/4 with bet365 to draw
He said: "That's what I have always wanted to do. Last year I beat Arsenal 3-2 when I was at Swansea. That was obviously a great moment and I hope we can do the same at the weekend.
"Going on loan has been crucial for me, especially the season at Swansea. We played in such a way that it improved my composure on the ball and it helped me learn how to play it out from the back."