I'm guessing either the mc did something really retarded and ruined their relationship, or some misunderstanding, or someone pulling strings in the dark...
I'm inclined for the first.
Before he got the memories, the very few first chaps made him look like he wasn't the brightest...