I feel like he's really drawing too much attention to himself. If the matriarch ever decided to take that symbol from him, he'd be fucked. Also, why doesn't he just use that symbol to get people to give him knowledge on martial arts? Seems like the smart thing to do here instead of getting everyone out to kill him when he can't even fight for himself yet. He relies on other people way too much.