Sunderland began life after Paolo Di Canio with a comfortable Capital One Cup victory over Peterborough as Tottenham thrashed Aston Villa and Manchester City romped to a 5-0 victory against Wigan.
There were also third round victories for Chelsea, Southampton, West Ham, Fulham, Hull City, Norwich, Leicester and Burnley on a busy night of cup football.
Sunderland caretaker boss Kevin Ball oversaw a 2-0 victory at home to Peterborough thanks to goals from Emanuele Giaccherini and Valentin Roberge, with the recalled Lee Cattermole excellent in midfield.
Chelsea enjoyed a routine 2-0 success at Swindon as Jose Mourinho turned to a number of the fringe players in his star-studded squad, with Juan Mata setting up Fernando Torres before substitute Ramires, on for the injured Marco van Ginkel, struck again before the interval.
Manchester City destroyed Wigan 5-0 in a repeat of last season's FA Cup final with Edin Dzeko opening the scoring before the floodgates opened with Stevan Jovetic bagging a second-half brace and Yaya Toure and Jesus Navas also on target.
Tottenham continued their impressive start to the season with a 4-0 romp away to Aston Villa as Jermain Defoe scored twice, with Paulinho finding the net and Nacer Chadli opening his account for the north London side.
Fulham came from behind to inflict Everton's first defeat of the season under new manager Roberto Martinez as Dimitar Berbatov and Darren Bent secured a 2-1 success following Steven Naismith's opener.
Gary Hooper rescued Norwich from a Capital One Cup exit at the hands of Watford as his extra-time winner capped a remarkable comeback. Javier Acuna and Marco Faraoni looked to have the Hornets on course for round four before substitute Josh Murphy reduced the deadlock with 13 minutes to go and Hooper levelled with almost the final kick of the initial 90 minutes.
Southampton made 11 changes to their team from the victory at Liverpool but still had enough to see off League One outfit Bristol City with Gaston Ramirez on target in the 15th minute and Jos Hooiveld completing the scoring seven minutes from time.
Ricardo Vaz Te hit a dramatic late winner for West Ham as they edged out Cardiff in a five-goal thriller at Upton Park after Craig Noone and Peter Odemwingie had cancelled out early efforts from Ravel Morrison and Matt Jarvis for the hosts.
Hull City overcame Championship side Huddersfield at the KC Stadium with Nick Proschwitz scoring the only goal of the game in the 59th minute.
Leicester staged a late revival to dump out midlands rivals Derby at the King Power Stadium as Danny Drinkwater and Anthony Knockaert struck in the final 12 minutes after Chris Martin had put the Rams in front.
Danny Ings' brace saw Burnley come from behind to defeat Nottingham Forest at Turf Moor with Matt Derbyshire having given the visitors the lead.