The former Spurs midfielder was only installed as Andre Villas-Boas permanent successor last month but he suspects he needs Champions League football to keep his job
The White Hart Lane club sit level on points with fourth-placed Liverpool in the Premier League, after recording their fifth straight top-flight away victory at Swansea City on Sunday.
Sherwood, who took over from Andre Villas-Boas in December, says finishing outside the Champions League qualification spots would be seen as a failure and could result in him losing his job.
Asked whether fourth place remained the brief for the campaign, as it was with his predecessor, Sherwood replied: "Yes, anything other than that is going to be a disappointment.
"If the season were to end tomorrow, I don't think the chairman [Daniel Levy] would be too happy because we're fifth. The final league position has to meet the expectation of the club, otherwise it's 'goodbye Charlie'."
Tottenham have not featured in Europe's premier club competition since the 2010-11 season, when they reached the quarter-finals under Harry Redknapp.
Sherwood believes his side should be one of the sides competing for a Champions League berth, but conceded the form of sides around them makes doing so a difficult proposition.
"Realistically, we should be in and amongst it but it's not easy is it? There's a lot of top teams in there and no-one seems to be giving any leeway," he mused.
"I keep looking at the results thinking 'surely they're going to drop points here today' and they don't seem to be doing it. It's going to go right down to the wire - it's about keeping that consistency and belief."