It was a disappointing evening for the Gunners, who were easily bested by the Championship side at the City Ground, losing 4-2 in a game which saw them concede two penalties in the second half.
And, as well as closing a viable avenue to silverware this season, the defeat signalled a new low in Arsene Wenger's two-decade tenure at the helm of the north London club.
1996 - Arsenal have lost an FA Cup third round tie for the first time ever under Arsene Wenger, last falling at this stage in 1996 vs Sheffield United. Dumped.— OptaJoe (@OptaJoe) January 7, 2018
In losing on Sunday, it marked Arsenal's first ever FA Cup third-round elimination during Wenger's 23-year managerial reign.
The last time the club were knocked out of the prestigious competition at the same stage was months prior to Wenger's appointment in 1996, when they were beaten by Sheffield United.
Ejection from the competition is yet another disappointment for the Gunners this season, who find themselves in sixth place in the Premier League with a fight to finish in the top four.
With the league title well beyond their grasp, the Gunners' have just two hopes of picking up any more silverware this season - in addition to the Community Shield.