When you get down to it, "black tie" is also a costume, but nobody says anything because nobody really thinks if it like that. Wearing lolita occasionally doesn't seem any different to me than wearing black tie occasionally, and really the only reason I can't think of anyone wearing black tie...