It's a weird flavor of patriarchy and transphobia.
Have a guy dress as a girl and somehow it brings to question his entire identity.
A girl dress as a boy, oh she's just a tomboy, she'll grow out of it. No big deal. Doesn't even count as crossdressing.