Trash father.
But really, why didn't he marry her as a concubine in the first place? Historically, marrying 2 sisters isn't that impossible, and he looks like he could support both. Unless its due to the strength of the wife's maiden family blocking him, in which case taking her as a mistress all these years would have been complicated as heck