The 21-year-old joined Leverkusen from Mainz last year, but had already confirmed his move to the Werkself in September 2010.
Schurrle was recently linked with a move to Chelsea again, with The Telegraph claiming that the Blues are ready to pay £15.4 million (€19m) for the Germany international. But Voller insists the forward is going nowhere.
"It's true. There was interest from England last year. It's obvious that clubs keep asking us about Andre," Voller said to Express.
"We are not letting go of him, though," he added. "He has only been playing here for a year now. We want to enjoy him a bit longer."
Schurrle has a contract with Leverkusen that runs until the summer of 2016.