The north London side fell to a shock 3-0 defeat to their local rivals before the international break to drop them to sixth in the standings.
But Holtby feels the time away will have helped boost the players' morale - with many of Spurs' stars recording wins for their respective nations - ahead of the trip to Aston Villa on Sunday.
| TOTTENHAM LATEST
|3/1||Tottenham are 3/1 with Coral to beat Aston Villa as both teams score
"They achieved a ticket for the World Cup, and a lot of other players won with their countries, so for everyone the confidence is very important."
Spurs' last visit to Villa Park saw them pick up a 4-0 win, and Holtby is hoping to repeat the performance which earned them a place in the next round of the Capital One Cup in September.
"I'm definitely looking forward to going in that dressing room again because I’ve got good memories of it!" Holtby continued.
"I think we’re up for it. Especially everyone who played against West Ham is definitely looking to come back from the result we had. We must keep it out of our minds, and try to get a win.
"We've won twice at Aston Villa now, twice 4-0. But they will be up for it as well."