The Latics have not played a game at home in the competition since October, 2010, and the Spaniard is hoping his side can take strength from a "big game" atmosphere on Tuesday.
The Latics face Bradford City on Tuesday at DW Stadium, their first home tie in the competition since beating Swansea City there in October, 2010.
Following wins over Nottingham Forest and West Ham, the former Swans boss believes success in the competition is a definite possibility if the Latics can continue to put in strong performances and use home advantage to their benefit.
"Every game is a big game now. Getting into the final eight is a fantastic prize for Bradford and for ourselves," Martinez told reporters. "We're going to get 5,000 supporters from Bradford, and that's going to make it a big game.
"We're really looking forward to it. We've had two fantastic performances already in that cup and now we need to get the same standard at home. It's the first time we've had a cup game at home in the last two years and we need to make the most of it."