I don't, as long as ambient temperature is below 25 or so degrees C.
I'm in Spain so this kinda rules out using it in summer for long. But most of the year it's fine.
I have to say the new silicone 'skin' they provided to Quest 2 owners makes the sweatiness a bit worse, but it is easier to clean. And the original Quest 2 material was prone to causing skin irritation so I didn't want to risk it for too long.
Do you not wind up sweaty? Every time I wear a VR headset for more than a few minutes it's .....moist.