The only reason he rejected her was cause like he said he has someone else. It's not a fault against her. If he had no one he would have fallen. I agree with Hayasaka that if she had a month or even less he would fall.
Kaguya sure was being an asshole in this one.