Boss Andre Villas-Boas claimed after their 1-0 victory over Hull City on Saturday that the White Hart Lane faithful lacked energy, adding that the crowd's apathy made securing the win more difficult.
But the England international is hesitant to follow suit, while insisting that Spurs have learned from their mistakes earlier this season.
"I'm not going to sit here and criticise the Spurs fans, especially because they've been great with me," he told talkSPORT, "but understand it is hard for us. We try and play good football and I think Hull set out in a 4-5-1 formation and came to defend.
|10/3||Andros Townsend is 10/3 with Coral to score against Everton|
"West Ham did that and ended up beating us 3-0. The main thing was not to get too frustrated, not to go too gung-ho too early, keep playing our normal football and just hope we can break them down before the 90 minutes. I think we learned our lessons and we got the three points against Hull."
Townsend also argued that Tottenham can finish in the top three should the squad come together in a timely fashion and confirmed that he hopes to recover from his injury against Hull in time to face Everton on Sunday.
"The sky's the limit for us if we can gel quickly and start winning games," he continued. "You can't really nail down a position. Other teams around us are dropping points so it's going to be tight, so who says we can't be up there in the top three?
"I've got a few broken bones in my hand but it's nothing too serious. I didn't want to let the team go down to 10 men so I had to run back on wounded and the crowd were behind me, the manager was screaming at me to go on so I didn't have a choice really. Hopefully I'll be back in time for the weekend."