He's actually being very generous and caring but because he's not expressive he comes off as indifferent. We already know she's attracted to him even if she tries to deny it, so it probably upsets her to hear the words she always wanted, but without the feeling of affection she would want to go...