The three-time champions opened their campaign in Brazil with a stunning 4-0 demolition of Cristiano Ronaldo's Portugal but have since underwhelmed, drawing with Ghana, edging out United States 1-0 and then scraping past Algeria in the last 16 after extra-time.
Consequently, Joachim Low and his players have come in for some criticism back home and Neuer says that he and his team-mates share that sense of frustration.
"We are not happy either with our performances," the goalkeeper told reporters on Thursday. "But, at the end, we've always come out as deserved winners. It's the winning that matters."
Neuer acknowledges, though, that Germany will need to be at their best if they are to overcome quarter-final opponents France in Rio on Friday.
"We're all thrilled to have the chance to play at the Maracana. It's going to be fantastic, but France are a very dangerous side," the Bayern Munich shot-stopper added.
"They're strong and versatile even if, like us, they have [yet to] put in a perfect game at the tournament."