People usually doesn't notice how he cares in his own way: he did carry on a conversation in the middle of the match, wich is supposed to be rude to the person you're talking to, and also is unreasonable to think you can hold a speech between plays...
Not just anybody would think Yugami is in his best behavior, even if they think they are not being rude or mean on purpose.
