I used to get that from wearing a headset at work all day.
Do you wear a balaclava? or anything under your helmet?
If you can't even wear like an underarmor beanie or something, you may need to upsize the helmet, or find one that's a better "fit" for your head.
I'd suggest a thin slick layer between your head and the helmet