The Ghana international scored the winner with three minutes left on the clock, needing the intervention of VAR, and then ran towards the section where West Ham supporters were seated to jubilate.
He later clarified that he was going to celebrate with his family.
"My family were up in a box, that’s where I went to celebrate my goal. I didn’t even know about any bottles," the 28-year-old said after the game.
The winning goal at the London Stadium was Ayew's third in six Premier League games this season.
Roy Hodgson's side are in sixth place, tied on 14 points with Leicester City and Chelsea, and are just two points behind second-placed Manchester City, whom they confront after the international break.