At least he knows that he was a terrible father. He even acknowledges how her maternal family wouldn't protect her... And he is still selfish.
Give her some money and a safe place and let her live her last years man. What are you gonna do to make it up to her for all those years?? I am really mad at him.
Original Libertia could have 100% gone down the same route as the mc. Her stubbornness on being the villainess that everyone sees her as was definitely her downfall (but honestly her downfall was probably way before that).