The Spain striker netted his first goal for the club ahead of the 2014-15 Premier League season as Jose Mourinho's men came from behind to defeat their Slovenian opponents
The striker, signed from Atletico Madrid for £35m earlier this summer, raced onto a Cesc Fabregas pass before finishing well, while Kurt Zouma also netted as Jose Mourinho's men came from a goal down to record a hard-fought victory.
The hosts hit the front five minutes before the interval, Nik Kapun smashing past young goalkeeper Matej Delac after Darijan Matic's chested lay-off on the edge of the area.
But Chelsea were level in the 56th minute as Costa ran on to a pass from another new signing - Cesc Fabregas - and thumped a finish high into the net.
And Mourinho's team were in front shortly after, Zouma stabbing the ball home after Fernando Torres saw his shot parried back out into the danger area by Olimpija goalkeeper Aleksander Seliga.
There was a moment of controversy in the 66th minute as Chelsea thought they had extended their advantage.
Seliga did brilliantly to tip Zouma's header onto the bar, with Branislav Ivanovic scuffing the rebound goalwards.
The ball appeared to have crossed the line, with the help of John Terry, but the referee ruled the goal out, seemingly for what he felt was a foul by Chelsea's captain on the home goalkeeper, though it mattered little in the end as the Blues comfortably saw out their victory.
The Premier League club continue their pre-season preparations against Vitesse on Wednesday.