I mean I find it more understandable than ignoring it especially when faced with the targets of his previous self's abuse. Even if he didnt do it himself he still experienced all the memories of the previous body; filtered through his own mental state. It's honestly weird that most stories like this the MC just ignores it as shit happened.