When he tries to cheer her up is when he’s the most honest to her. When he said the first “cute” , well, it was his honest thoughts.
His irritation matches the feelings for now, but he’s slowly discovering that maybe her company is not so bad, so...progress!