The star striker says the loss to Akwa United will not augur well for the team after they failed to defend their title for the third time
The Owerri side were leading through a first half goal scored by David Tyavkase, but allowed the Uyo team to equalize few minutes to the end of the game.
They eventually lost the game 5-4 on penalties.
Ogbu, who scored the winning goal that gave Heartland the trophy in last year's final against Lobi Stars, told Goal in Enugu that he is pained that the club will not be able to retain the trophy.
"It is not as if I underrated Akwa United, but this is one game Heartland should have won. I am really not happy that they did not even play up to the finals of the competition.
"I don't know what the problem is, but they should have settled it and fully concentrated on the task ahead. The problem with losing matches the way they did is that everybody will begin to look for scapegoats.
"That is why they should sit down and look at the areas of improving in all aspects of the game. I have played for the club and I know the spirit in the team when they want to play any match.
"I was monitoring the game and already concluded that Heartland would sail through, only for Akwa to equalize. I remembered the way we approached the competition last year.
"In spite of all the financial constraints, we braved all odds to beat Lobi Stars to lift the trophy. My advice will be that they should forget about the Federation Cup since they are out of it and focus on the Premier League.
"They should not give up on the League. Anything can still happen," Ogbu sounded off.
Ogbu is presently in Nigeria to treat his leg before he will return to Tanzania where he hopes to sign for a top club.