Arsenal suffered a humiliating League Cup quarterfinal exit to fourth tier Bradford City on Tuesday, losing 2-3 on penalties after an absorbing game finished 1-1 at the end of extra time at a packed Valley Parade.

The Premier League side needed an 88th minute goal from captain Thomas Vermaelen to force the extra period but failed to make their superiority tell and it was Vermaelen who missed their final spot kick to send the minnows through.

Garry Thompson had scored with a tidy far post finish in the 16th minute to give a surprise lead to the hosts who then held off a second-half barrage before Arsenal's Belgium centre back Vermaelen levelled with a far-post header.

In the night's other quarterfinal, Andreas Weimann scored two late goals as Aston Villa booked a place in the last four by coming from behind to beat Norwich City 4-1 away.

Arsenal, without a trophy since winning the FA Cup in 2005, selected a strong team but got off to the worst possible start.

Thompson put the hosts ahead with a tidy side-foot finish at the far post after Will Atkinson climbed high to flick on a Gary Jones freekick from the right. Having ruffled Arsenal's feathers, Bradford enjoyed a period of pressure before the visitors gained a foothold and began to look dangerous with Francis Coquelin firing a drive against the woodwork in the 38th and Gervinho guilty of a terrible miss.

Arsenal got on top in the second half and pegged their opponents back but struggled to create chances against a stubborn backline. Substitute Alex Oxlade-Chamberlain forced a good save from Duke with Arsenal's first effort on target in the 70th minute, before Vermaelen rose at the far post to head home a cross from Santi Cazorla with three minutes remaining.

Arsenal piled on the pressure in extra time but a second goal was elusive and the match went to penalties, with Bradford full of confidence having won their last eight shootouts. Arsenal's Spain midfielder Santi Cazorla and Morocco striker Marouane Chamakh missed with the visitors' first two spot kicks.

Bradford let them back into the contest when Szczesny denied Ritchie Jones and Stephen Darby, but Vermaelen hit the post with Arsenal's final kick as they suffered their first defeat to a fourth tier side since losing to Wrexham in the FA Cup in 1992.

The night's other tie pitched the competition's first two winners against each other with five-times holders Villa having lifted the trophy in 1961 and Norwich 12 months later.

It also marked the return to Carrow Road of former Norwich manager Paul Lambert who was given a mixed reception, having left the club in the close season after guiding them to back-to-back promotions and keeping them in the Premier League.

The hosts went ahead when Steve Morison seized on a knockdown from Matt Lawton in the 19th minute and smashed the ball home on the half-volley. But the lead lasted only two minutes before Brett Holman drew Villa level with a first-time shot from outside the area.  Weimann, a first-half substitute for the injured Darren Bent, converted Eric Lichaj's cross to put Villa 2-1 ahead and then latched on to a Christian Benteke pass for his second goal. Benteke scored Villa's fourth in added time.