Likelihood of things going south honestly feels pretty low... The manga tends to jebaits us with these kinda things and then throw a more wholesome swing to the story instead, and it has the liberty to do so because said wholesome option still remains interesting. Like if he says no, what will he say then? Is he gonna show more crazy? What if we build up this whole aspect of him not remembering things if it doesn't have an emotional connection and take it a step further and add more twists to that? There's still stuff to feed us with the wholesome route.
Let the psychological manga remain psychological :3