So how does the guild have NO authority here? If he repeatedly says I don't want to party with them and several people in the guild know about it, they can't say no when he explicitly states he didn't party with them? Even being cautious and thinking a young adventurer is pulling a scam...