The Argentine made it four goals in two games following his strike against Bordeaux last week, while big-money signing Radamel Falcao struck again
The hosts, who marked their return to France's top-tier with a 2-0 win over Bordeaux last week, enjoyed a bright start and could have taken the lead as early as the sixth minute, but Lucas Ocampos failed to beat Laurent Pionnier in the opposition goal.
However, boss Claudio Ranieri would not have long to wait to watch his team open the scoring, as striker Radamel Falcao converted from the penalty spot after Ocampos was felled in the area.
Jean Fernandez's men went in search of a swift riposte and found one through Victor Hugo Montano, who headed home the equaliser some six minutes later.
As both sides were poised to enter the interval on level terms, Riviere pounced for his first of the game, evading his marker before lobbing the out-rushing Pionnier on the stroke of half-time.
It got worse for the 2012 Ligue 1 champions 12 minutes after the restart, as Yannick Ferreira-Carrasco's corner was met by the boot of Riviere, who side-footed home from close range to establish daylight between the teams.
La Paillade then faced a seemingly insurmountable task after Daniel Congre was dismissed midway through the second-half for knocking Ferreira-Carrasco off balance on the edge of the area as the last man.
Riviere completed the rout 10 minutes from time, heading into an empty net after Pionnier could only parry away a deflected shot.
Monaco host Toulouse on Friday in a bid to extend their 100 per cent start to Ligue 1, while Montpellier host Sochaux on Saturday.
Elsewhere, Lorient picked up their first three points of the season against Nantes after being forced to come from behind at the Stade du Moustoir.
A Fabien Audard own-goal put the visitors ahead after 17 minutes, but goals on 39 and 61st minutes from Vincent Aboubakar and Jeremie Aliadiere respectively ensured Christian Gourcuff's men moved up to 10th.