The Frenchman got the last touch from Theo Walcott's delivery to secure a slightly nervy three points at St James's Park that took his side back above Manchester City
Arsene Wenger's men were sternly tested by a Newcastle side harbouring Champions League ambitions but they did enough to take the points in an encounter largely devoid of goalscoring opportunities.
The hosts created the better chances for much of the contest but a lapse in concentration in defence allowed Giroud the space to glance home the winner after 65 minutes.
The France international got the faintest of touches to head home his first goal since his double against Southampton in November, sending Arsenal back to the summit.
|VIEW FROM ST JAMES'S PARK
|By Harry Slavin
Three big points for Arsenal as they end the year top of the Premier League courtesy of Olivier Giroud's header.
The Gunners were by no means at their sparkling best but they showed all the traits of a championship-winning side here as they dug deep to produce a win by the narrowest of margins.
Alan Pardew might be a little disappointed with how little his side made, with their best chances self-inflicted by the Arsenal back line. In the end, though, both sides were competitive and both will have an optimistic outlook going into 2014.
Cheikh Tiote replaced Hatem Ben Arfa in the Newcastle starting XI after missing the win over Stoke City through suspension, while Laurent Koscielny returned to an Arsenal side who were missing the midfield talents of Mesut Ozil and Aaron Ramsey.
The north Londoners enjoyed the lion's share of possession in the early stages but it took over 20 minutes to craft the game's first real opportunity as Jack Wilshere fired over the crossbar from long range.
Newcastle full-back Mathieu Debuchy then went close with a half-volley at the near post before team-mate Tim Krul was forced into the first save of the match from Tomas Rosicky's drive.
The hosts finished the half the stronger as Moussa Sissoko forced a flying save from Szczesny, with Debuchy heading against the underside of the bar from the resulting corner.
Newcastle carried that momentum into the second half and would have taken the lead had Yoan Gouffran been able to capitalise on a mix-up in the Arsenal defence caused by Vurnon Anita's right-wing cross seven minutes into the second period.
The visitors struggled to break down a well-organised defence for much of the encounter. However, after 65 minutes, they broke the deadlock when Giroud flicked home Theo Walcott's free kick.
That goal provided Arsenal with added impetus and Wenger's men would have doubled their advantage had it not been for a piece of brilliant defending by Debuchy, who headed Walcott's goalbound effort off the line via the crossbar after Krul had kept out the England international's initial effort.
Arsenal defended their lead with relative comfort for the most part but their hard work was nearly undone by Szczesny, whose clearance struck the face of Remy eight minutes from time, only to trickle narrowly wide of the post.