I'm guessing it's not only the reference to a female, but also "young lady", sure, he probably means it in a polite way, but what would you usually imagine if you hear young lady? a young woman, maybe even girl of high standing (or at least the attitude), inexperienced in life, rather weak - more or less like the girl he hates so much - he would probably be not so pissed if he would call him sorceress or warrioress