@Greyvenn Keep in mind that he doesn't know that she's horribly abused and lacking any pride. Keeping your head bowed until told to rise by authority figures (which in 1920s Japan
is the husband) is not just subservience but also indicative of discipline, etiquette, and humility. I don't think Kyoka was as 'attracted' as he was surprised and curious about what made Miyo different from his other prideful candidates, especially considering that she the first daughter from a prominently powerful family.
TL;DR - Kyoka was expecting Miyo to be a stereotypical 'rich lady,' acted rude to try and scare her off quickly, and was surprised and maybe even hopeful when it didn't work.