On one hand, by the time you get to a group of four people, it's harder to sustain "That guy is bad news, isolate him" rumours. So adding that guy could just be the next step in beating the gossip.
On the other hand, nope. Dude gives me a bad feeling.