His distrust is justified to a certain degree, you can be betrayed by a summoner, just like anyone else but on top of that, the summoner could be betrayed by the summoned beast and put everybody else around at risk. You can't compare a sword, bow or any other weapon to living creatures (either...