The holders will travel to Wales as the Reds' boss faces his former club and Roberto Di Matteo welcomes the Red Devils to Stamford Bridge, while League Two Bradford play Wigan
The Irishman got his first win as the Reds' boss courtesy of Nuri Sahin's 82nd-minute winner against West Bromwich Albion at the Hawthorns, while Swansea came from 2-1 down to dump out League One Crawley Town.
Manchester United, meanwhile, faces a tricky trip to Stamford Bridge to meet Roberto Di Matteo's Chelsea after they edged past Newcastle 2-1 at Old Trafford. The Blues booked their place in the last 16 after a crushing 6-0 victory over Wolves.
Arsenal also hit League One strugglers Coventry for six, with Theo Walcott netting a brace and the London club also faces an away trip against Reading, while neighboring Spurs draw Norwich City at Carrow Road.
Neil Warnock's Leeds shocked Everton with a 2-1 win at Elland Road on Tuesday night and was rewarded with another home tie against Premier League new boys Southampton.
Swindon Town has already knocked out Premier League opposition at the County Ground in Stoke and it will be hoping to do the same when it welcomes Paul Lambert's Aston Villa, which knocked out Manchester City with a shock 4-2 win at the Etihad Stadium.
League Two highflier Bradford is the lowest-ranked team left in the competition and it travels to Wigan Athletic after coming from 2-0 down to beat Burton Albion 3-2 in extra time.
Fourth Round Draw:
Sunderland vs. Middlesbrough
Swindon Town vs. Aston Villa
Wigan Athletic vs. Bradford City
Leeds United vs. Southampton
Norwich City vs. Tottenham Hotspur
Liverpool vs. Swansea City
Chelsea vs. Manchester United
Reading vs. Arsenal