As with most adult conflicts, it was on both of them. Honda was quite really shocked and his expression hurt Kaori, while she herself may have been hurt before and decided to ignore him to protect herself.
Actually, that would depend entirely on Nanami, she already said she wouldn't go out with him at all, and since she's an actual person, who said she has to anyway?