Just because the plan failed doesn't mean its the end of it.
It is just like you wanted to buy something, and once you get the the shop, it is no longer there, but once you're home, someone suddenly give it to you.
I mean, it's still quite early to say anything, the story still moving, it is not end. Also being truly loved is what everyone wants, and ofc processing such trauma as a child could only be bad for future, our protagonist here is still considered lucky that his mother supports him, chances that she might also experienced it during childhood.
Just remember, what has we experienced is what makes the current us.
Also, while loving harem, I might not mind OTP for this one.