Since they're twins, the vastly different treatment that they describe here and in chapter 175, along with Haesol being taken by her mother as described much earlier on, make me think it's gender related. The father needs a male heir or something, and Haesol is just an extra that he keeps alive...