Attram's men have gone five games without a victory, picking only two points and languishing at the bottom as a result.
The player-coach is under pressure to perform and this game could be his last time in charge should his side end up in defeat.
"I am very concerned because we are the only club without a win after five games. We have played good games but the results ain't coming our way," Attram said.
"I believe that we can make amends on Sunday against Hearts of Oak. Derby games can go anywhere with little efforts and concentration.
"The supporters are right to complain but they must keep backing the players to achieve victory in the game against Hearts. We need to come together to achieve success," he added.
Hearts were beaten 2-0 by in-form Aduana Stars last weekend in Dormaa Ahenkro, leaving the Phobians seven points behind, but coach Frank Elliott Nuttall insists his charges have recovered from the shoch and will win the derby.
“We were disappointed to lose [to Aduana] and we are disappointed to lose any game,” Nuttall told his club's official website.
“We spoke about the game when we came back into training and we have since trained well, trained hard and intensely.
“We are focused again now on the next game and we have spoken about how we can improve. Like I said before, this is a work in progress. It is a big project and there is plenty of work to be done. A derby is not bigger than any other game. It's the same three points but we must win,” he added.
Hearts striker Patrick Razak will have to pass late fitness test before he can play part of the game but Olympics are without any major injury after Abel Manomey, who has scored three goals, returned to training this week.
Since 1999, the two clubs have met 20 times, with Hearts picking nine wins while Olympics winning three times and eight games ending in a draw.
Hearts have lost only one of their last eleven games at home, winning four and sharing the spoils six times. Olympics on the other hand, have failed to win any of their last eleven away games, losing six and picking five draws.
In the last nine Accra derbies, Hearts are unbeaten, winning five while Olympics have managed only one win and three stalemates.