Unfortunately for Duke Etam, everything Duke Colin said was correct. It's clear that Duke Etam's personality was quite dislikeable. Even the way he tried to salvage his mistake regarding Ayrin's adoption and how he confronted Duke Colin in this chapter was REALLY BAD.
His only saving grace is that the author slated him to become Ayrin's father.