Ejiri is the "strong sense of justice but doesn't think things through" type. Killing the fake heroes party is mistaking the real problem- the church leadership. She killed a symbol of the problem, not the problem itself. And it will cause a reaction from the church. They want to maintain their secret and preserve their righteous image, but the actual heroes party just showed themselves to be a threat. Begin the church assassins arc!