You just got beaten by a guy who didn't throw a punch. A sword isn't going to overcome that skill gap. Even his parents should realize that.
Also, Noh not only forgot about teaching her how to fight, he also forgot she's supposed to teach him how to read.