I too never dry my hair.
Coz I'm bald....
In all seriousness, though, when I did have hair, and even when it was shoulder-length, I never used a blow-dryer. I just used the towel to dry it. I'm genuinely curious about why you should use a hairdryer vs. a towel.