I never got listening to music when riding.
I crank the stereo when I'm driving because I HATE FREAKING DRIVING and it distracts me from how much fun I'm not having.
I listen to the ipod on my bicycle, but usually only after 40 or so miles and I'm tired. The music helps keep my mind off of how tired I am.
I never have listened to music when riding, nor has it tempted me because I love riding, so music is not necessary. And I love music!
That said, I really should probably start wearing ear plugs. I'm over 50 and have probably, between work, playing in a rock band when I was younger, and riding for 40 years (a lot of those years helmetless like a dummy), I probably have done enough damage to my hearing and should mitigate any more.