How would the Teacher know that his slimes confirmed it? And if you take away knowing with the slimes, his response sounds like he just guessed it. i.e: "I didn't think there was a monster stampede in the first place."
We're biased because we know about Yuuji. But, If another dude said that, it...