The Premier League belatedly kicked into life with a couple of barnstorming encounters and a shock result at Anfield, as previously unbeaten Liverpool lost to Southampton.
Dejan Lovren's header was enough to give Mauricio Pochettino another outstanding win as Saints boss. Southampton defeated the Reds 3-1 in March.
At Upton Park, two Leighton Baines free-kicks drew Everton level after West Ham took the lead twice through Ravel Morrison and Mark Noble, who was later sent off. Debutant Romelu Lukaku struck the winner, with the Toffees the only remaining unbeaten side in the Premier League.
Premier League pictures
Newcastle too lost 2-3 at home having led twice. Loïc Rémy hit two on his home debut but Hull fought back through Robbie Brady and Ahmed Elmohamady, before Sone Aluko gave Steve Bruce's team their first win on the road this term.
West Brom trounced Sunderland 3-0 for their first victory as the pressure mounts on Paolo di Canio. Stéphane Sessègnon scored on his debut versus his former club while Liam Ridgewell and Morgan Amalfitano were also on target.
In the early kick-off, Brad Guzan saved a Robert Snodgrass penalty and Libor Kozák came off the substitutes' bench to give Aston Villa their first three points since the opening day.