All the people shouting "kill them, kill them!"
With what?
With what?
His shield specifically has a fear effect, but it can't do physical damage outside of the "punch them in the face with my extremely low offensive stats" variety. Rishia wouldn't be willing at this point even if she was capable, Hunter can't and doesn't want the kind of trouble that comes from murdering nobles, the shikigami's too cute to go on a murderous rampage (for now), and Filo needs time to recover emotionally. Naofumi undoubtedly wants to rampage... and that's partly what he's doing, but he hasn't lost his mind in the process, he knows his own capabilities and weaknesses.