“If it were me, I’d be delighted. I’d have no choice but to fall for that girl,” - Walter pg. 7
So the maids at the main estate are too reserved about their affections for Walter for him to notice, or perhaps he is thickheaded...
Maybe the second son will find love in a future chapter... just not from Duke of Death!