I think "Albatross Songs" is worthy of its own post, as started in the Jazz Club comments, so here it is...
So far we have:
"Shiny Happy People" - REM
"Creep" - Radiohead
"Nothing Compares 2 U" - Sinead O'Connor
"The King Of Rock & Roll" - Prefab Sprout
"Born In The USA" - Teh Boss
"Rip It Up" - Orange Juice
"Hi Ho Silver Lining" - Jeff Beck
"You're Gorgeous" - Babybird
"Come On Eileen" - Dexy's
I'd like to add:
"Smells Like Teen Spirit" by Nirvana, the song that came to embody everything they hated about the 'jock meathead' fans that they gathered by having a massive pop smash.
I've heard that Randy Newman hates his most famous song "Short People" cos it's essentially a novelty song.
I'm sure there's many more - any to add, 'Spillers?