The Gunners impressively saw off arch-rivals Tottenham and will face Coventry next in the fourth round, having last won the competition in 2005
Newcastle United were also knocked out after Cardiff City came from a goal down to win 2-1, handing new boss Ole Gunnar Solskjaer a winning start to his reign.
Chelsea, Liverpool and Arsenal all advanced with identical 2-0 victories, with the Gunners perhaps the most impressive of the trio after defeating arch-rivals Tottenham. Manchester City, meanwhile, stumbled to a 1-1 draw at Blackburn Rovers and will have to undergo a replay.
With the draw for the fourth round being made on Sunday night, with Arsenal to face Coventry. Chelsea will take on Stoke, while Liverpool face Bournemouth or Burton Albion and City will host Watford or Bristol City if they win their replay.
It is Arsene Wenger's men who have been picked by Goal Singapore readers as the favorites to win the FA Cup this season, with 30.7% believing they have the best chance of taking the trophy. The last time Arsenal won the competition was in 2005, which was their 10th title and also their last major trophy.
A further 22.2% voted for Liverpool as the likeliest side to win, with another 15% picking City and 23.5% choosing Chelsea. Only 2% thought another Premier League side other than the four mentioned would emerge triumphant, with 6.5% believing a non-Premier League side will upset the applecart.