Sonic Youth- Panty Lies, Goo, cover of ‘Nic Fit’
The Clash- Straight To Hell
Screeching Weasel- Phasers On Kill
Public Image Ltd.- Rise
The Replacements- Dose Of Thunder
The Cure- The Lovecats
Bad Religion-A Walk
The Smiths- Vicar In A Tutu
Prodigy- Fuel My Fire
Tricky- Talk To Me
Pretenders- Watching The Clothes
Fugazi-F/D, Closed Captioned, Runaway Return
Black Flag-Damaged
Lol, yeah a few Beatles songs I dislike, and I agree, Under My Thumb sounds kind of sexist to me, but I love the Stones. And there are bands that completely butcher classic songs when covering them.

Best answer:

Answer by Matt
OMG, I am SO with you on the Vicar In A Tutu! And also, Never Had No One Ever. And some ones on Strangeways.

Add your own answer in the comments!