The combative midfielder, who joined the French champions in the summer from Everton, made his first appearance for the Parisians in the European competition and delivered a fine performance.
Angel Di Maria opened the scoring for Thomas Tuchel’s men in the 14th minute of the encounter after receiving a pass from Juan Bernat.
In the 33rd minute, Gueye set up the Argentina international for his second goal in the game to ensure his side go into the half-time break with a comfortable lead.
Thomas Meunier then sealed the victory in the 90th minute of the encounter for the Parc des Princes outfit.
Gueye featured from start to finish in the encounter, in his fourth appearance for the Parisians in all competitions this season, while Cameroon international Eric Maxim Choupo-Moting was introduced at the hour mark for Mauro Icardi.