Neither of them acted on it but the other guy's fantasies were explicitly about a non-consensual interaction. Toda likes her, fantasizes that she likes him back, and that she wants smexy times with him. Different moral character to it.
Also, thanks Helvetica. Glad to see you're still translating this series.