Also through to today's draw were Cardiff City, who beat fellow Championship side Wolves 2-0, as they reached the last eight for the first time since becoming the only non-English club to win the FA Cup in 1927.
In Saturday's other all-Championship fifth round clash, West Browmich Albion beat 10-man Coventry City 5-0.
Frank Lampard put Chelsea ahead at Stamford Bridge with an 18th-minute shot -- the England midfielder's 100th goal for the Blues.
But Huddersfield, who knocked out Premier League Birmingham in the third round, shocked the crowd just moments before halftime when Michael Collins struck from 12m.
Lampard then settled Chelsea's nerves in the 60th minute before Salomon Kalou put the result beyond doubt.
Rickie Lambert's deflected free-kick six minutes from time was good enough for Bristol Rovers to see off Southampton.
Premier League Portsmouth were away to Championship strugglers Preston yesterday, while the day's other fifth round tie saw Pompey's top-flight rivals Middlesbrough travel to Sheffield United.
RSS