If the Duke wasn't enchanted from word "Go" in the original timeline, the way he's acting now is the only logical way he should have acted when presented with someone who claims to be his daughter. Even if he didn't have affection for his daughter; even if he loved his mistress. As a noble of his rank, just accepting a stranger as a legitimate child is idiotic.