Tbh, my first thought was that their mother cheated on MC's father (since only the different father was mentioned), and she left out of a sense of guilt and/or resentment (she chose to leave after graduation saying she couldn't live there anymore). Not sure if that's how you meant to translate...