At least from his point of view the "I don't belong here" kinda makes sense. The girls are sidelining him, just not for reasons he thinks they are.
I also approve of the choice to go for winter clothing in a winter dungeon. That is one of those details you don't see that often.
---
Thanks...