The thing that bothers me is the switch from "I only like 2D girls" to "I have made a commitment to 2D girls that I refuse to break even if I'm attracted to a real one". The initial point of it was that it was a trauma, not a choice. He couldn't trust girls, got immersed in eroge, and stopped being interested in real girls, since he felt insecure and uncomfortable with them. Now he's acting like he has to defend the trauma even when he realizes that he is physically attracted to Ayame. He no longer has an innate rejection of her, he is consciously choosing to reject her for no reason ('She deserves a better man', seriously?).