I couldn't see any wrong with the girlfriend either, she definitely like him but him he only think her someone that always treating him harsh.
Beside didn't he do that adventure test to checking magic power before when he was adventure. Why does he denied himself that much?