Honestly, as much as I'd like that to be the case I'd be both surprised and confused by it. The two were said it in a condescending way with a hostile, or at the very least, antagonizing look on their face.
I suppose that it's possible that's just how Yuu remembers it since we're going off his...