With four minutes into the encounter, the former Chelsea winger opened the scoring for the Old Lady.
In the 14th minute, Thomas Delaney levelled matter for the Black and Yellow before the Ivorian restored the lead for Pal Dardai‘s men from the penalty spot.
Dan Axel Zagadou brought his side back to contention with his 47th-minute effort before Marco Reus grabbed the winner at the death to deny the Olympiastadion outfit a share of spoils.
Hertha were reduced to ten men in additional time after Vedad Ibisevic picked his second booking and was subsequently sent off.
Despite the defeat, the Old Lady remain in the 10th spot in the league standings with 35 points from 26 games.
They will hope to bounce back to winning ways when they trade tackles with RB Leipzig on March 30.