So, Japan is very culturally gendered when it comes to clothes, as you see skirts way more often than you do in the west, and in manga and anime, the whole "You are a girl, wear this skirt" is everywhere, so maybe the MC is just so JP ingrained to see clothing and assume pants=male despite it...