@Halo - it's girl threw him away, twice, not other way around. No, he's not obligated to be mind reader or use his soul to feel her soul to get through her bullshit.
@Halo
1. It's sometimes clearer from the side
2. He worry about other things to pay attention to petty shit
3. She ALREADY rejected him once at the start of the manga. Which really hampers signal interpretation.