If I remember right, it has something to do with the other guy, Hayama. I think Tagami was jealous of him, and he asked Mugi if she’d have more confidence if Hayama said that he liked her. She didn't know how to reply, but he took the look on her face as her answer. So basically, he’s jealous...