I think that's what happened. Because I think in one of the first 15 chapters she realized that they never actually hated her and actually loved her. She was just blinded and couldn't notice it until her second life. For the bandits, I was under the impression that Ohara just told her to leave...