Yeah, even though they're all extremely honor driven, he is staying in a cave because he murdered a bunch of people, if he really wanted revenge he could've just left. What can they even do to him? They already hate him, he can just hunt them down if he feels that strongly