A 1-0 defeat to Bundesliga leaders Bayern Munich on Saturday meant Dortmund failed to score for the fourth time in five matches across all competitions.
Dortmund face Hoffenheim in the DFB-Pokal quarter-finals on Tuesday and Klopp has challenged all his players to step up their efforts in front of goal.
“Every team is somehow dependent on individual players. But depending on Reus or Aubameyang in general is not our problem," he told reporters.
"In scoring areas, we lack determination. We are often 18 yards from goal, but then do not have the ideas to convert the chances.
"We need to be tough and get into promising positions that make it difficult for teams to defend against.
"It was clear that we wouldn't create 20 chances against Bayern. We are aware that we have to be more consistent in attack. But we must not act as if we played disastrously against Bayern."
Klopp is confident Reus will be available to face Hoffenheim but revealed the fitness of Ciro Immobile is not yet clear.
"Marco Reus was treated intensively after Bayern, but there should be no problem for Tuesday - nobody has looked worried," he said.
"Ciro Immobile completed a training program on Sunday that would not have been possible on Saturday, but playing a match is something different."
Hoffenheim suffered a 4-1 home defeat to Borussia Monchengladbach on Saturday but Klopp was more eager to recall his own side's 1-0 victory back in December, which helped trigger their surge away from the bottom three.
He continued: "That loss surely won't help them, but they had big injury problems and Ermin Bicakcic was suspended. Eugen Polanski and Pirmin Schwegler are also important players for Hoffenheim, who were missing.
"In the first half of the season we played one of our few really good games against Hoffenheim. That is our benchmark, rather than their match against Gladbach.
"I hope the cup is not our last chance to get something positive from the season."