It was also the Phobians’ first victory against Dwarfs in three seasons at the venue and the first after three attempts this year.
Hearts coach Henry Wellington made six changes to the side that started in their 3-1 home defeat to Ashanti Gold last week. Defender Christopher Bonney was handed his debut game against his former club while goalkeeper Ben Mensah returned after missing the action last time.
Dwarfs were the first to launch an incursion by the second minute, when Alhaji Mustapha latched onto a pass and crossed it to Paul Abeka Nkrumah whose effort was saved by goalkeeper Mensah.
Three minutes later, Esso dazzled past two Dwarfs defenders but he was brought down outside the box. Malik Akowuah's resulting free-kick was blocked by the human wall before Bonney fired the rebound wide.
On the 12th minute, Abeka was played through again by Abu Naba but he couldn't direct his effort on target once more as the supporters began to show signs of frustrations. Esso's lob on the other side of the field was tipped for a corner-kick by goalkeeper Frank Andoh.
The hosts were on ascendency by the 30th minute, with winger Joseph 'Bobby Short' Tagoe causing problems to the back four of his former club.
On the stroke of half-time, Dwarfs appealed for a penalty after Solomon Gyesi Okudzeto was tripped in the Phobians’ box following a tackle by Benjamin Agyare but referee Awal Mohammed ignored their chants.
After the break, Hearts brought on Patrick Razak for Sellasie Bakai and that substitution changed the pattern of the game in the visitors favour.
Esso came close to opening the scoring by the 47th minute when he rose above his marker to meet Bonney's cross but his effort narrowly missed the target.
Four minutes later, Razak connected a pass from Isaac Mensah but his effort was saved.
The Phobians broke the deadlock by the 58th minute through winger Razak who calmly slotted home a pass from Kodei.
With Dwarfs pushing forth for the equaliser, Hearts doubled the lead on 76th minute through Esso. The former Dwarfs poster boy silenced the home crowd with a fine finish.
Dwarfs came close on several occasions but failed to beat goalkeeper Mensah, who picked his first clean sheet of the campaign on Thursday.
Hearts have moved six places up to seventh position with four points and will host Dreams FC next weekend while Dwarfs who have dropped two places, will travel to Anyinase to face newbies Karela.