In most mangas, adventurers are known for being a rowdy bunch. Which was why the old man was still playing along despite the obvious red flag.
I personally wouldn't trust you in a position of authority if you think their 'appearance' is enough not to trust them