I've said this before, but I think that his lack of self-esteem is the actual true core of the story. This is what the author actually wants to talk about in their story, the girls are there for us to not get bored as eye candy.
Them resolving his self-esteem issues will likely be the climax of...