When he first arrived in that world he was level one, since then he's fought two legendary creatures (and tamed them both) and killed that one dog-like enemy. Even if beating Tomoe and Mio doesn't count towards exp, then his kill of the dog should've.