Dortmund, who had to share the points after a 1-1 draw, have now won just one of their last seven trips to Gladbach and Klopp said his side could have ended up losing but were still upset with the result.
“Gladbach hurt us every year and did so again today, although they defended unpleasantly," he told reporters.
"We were initially dominant but our grip on the match began to lessen and Gladbach then emerged. There are worse things than a draw here, but we are not very happy.
"I am not filled with satisfaction, but we put in a really good away performance for over an hour. [But] the game intensified after half-time as Mats Hummels could not continue."But when asked about a potential offside in the build up to Gladbach’s equaliser, the Dortmund coach preferred to focus on his own side's failings, adding: “Offside calls have become a part of footballing folklore.
"Instead of clearing the danger, we got caught out, and then the ball deflected twice to add more insult to the injury.”
He also conceded that his team will have to work harder when his side face Bayern Munich on Wednesday, but said that it would be one that his team would be prepared for.
“This is a totally different game.
"Today we had quite a lot of possession, especially in the first half. That will not be our problem on Wednesday. We have to defend properly in Munich and take the opportunities that we get.”