Talking shit about the person that took in the classmate that you want to get close to is a stupid move.
Also, I see Haru realized what she meant by that. I wouldn't be surprised if Gary's mom liked Midori as well, but got with q man to hide her sexuality.