Tuesday's comfortable 3-0 victory at Old Trafford saw City close the gap on leaders Chelsea to three points, with Manuel Pellegrini's men boasting two games in hand.
|MAN CITY LATEST
|11/4||Manchester City are 11/4 with PaddyPower to beat Arsenal to nil|
Pellegrini's charges face Arsenal on Saturday and the Belgium defender expects another strong display to maintain their five-game unbeaten run in the league.
"It's just one little step [beating United]," Kompany told Sky Sports after the victory. "The other teams are still very good.
"I mean, games have to be played. As long as we don't have the points, I don't consider ourselves there yet.
"With the game against Arsenal, obviously it's good in a way because you don't have to make a big effort to get the lads focused again."