My Guess: He's testing to the girl to make sure she really likes his younger bro, and once he realizes they're legit, he's annoyed that they aren't properly expressing themselves. So he's trying to push them together by making his bro jealous. And maybe along the way he falls for her for real (because shoujo authors have a hard time not doing love triangles).