This dad is a shit person. But not necessarily the most evil (atp from what i read anyway) The worst is just his delusion on being "good" or whatever it means. If he just.. get up and leave the family, it honestly might be better for all of them.
He is MARRIED to this family, the least he can...