I don't think most of the bandits are bad people especially considering the guy who betrayed them and planned to sell Hanano to the lord talked about how the lord had gotten some real bandits on his side.
On another note Lotte is cracked! Coming in like a fucking meteor.