I mean, in the previous chapter, she said she can't date him, told him to go take care of Kaori, and that she'd always be waiting for him. Only the author knows what Yoshioka truly means by all this... It doesn't really make much sense to me. So yeah, he left because she told him to.