The Magpies are aiming at a return to winning ways, having gone seven straight games without a victory.
Atsu, who is eyeing a return to Rafael Benitez's starting XI following a recent comeback from injury, has not hesitated to lay clear their ambitions for the showdown at St. James' Park.
“This is a must-win game for us," the Black Star told The Chronicle.
“I know all the players will give everything in that game.
“We assure our fans that we will fight back and make sure we make them happy in the next game.
“I just concentrate on giving everything I have for Newcastle United now.
“I am pleased to be back from injury and able to help the team do their very best.”
The midweek tie will also be a special one for Atsu, who is set to face former side Everton for the first time.
Three seasons ago, the 25-year-old was on the books of the Toffees, for whom he made five league appearances involving one start.
Apparently, that spell did not go as planned as the Ghanaian also had to battle with injuries in addition to his limited game opportunities.
This campaign, he has so far made 12 outings involving 10 starts and a goal for Newcastle.
The Magpies currently sit two places above the relegation zone on the league table.