It's fine if the Duke wants to make this a distant political marriage, but yeah, with this many handsome men, how is her having an illegitimate child via affair not a concern?
His reasoning for picking her is kinda off too. Chloe was so socially isolated, yet craved acceptance, she's a co-dependence case waiting to happen. Why would she be the one to not fall in love with him?