I'm surprised the villagers haven't rebelled against that dumbass bastard of a village chief. The most they did was point farm implements at him but stopped at that. He's so much of a PoS he also beats his wife on top of cheating on her with a mistress. The poor woman was only arranged to marry him, so she's got really rotten luck. If I understood the scene correctly, his wife is among the refugees fleeing his act of running the village into the ground.
Ivy leaving that accursed village was one of the best decisions in life she's done, if she grew up there without somehow getting sold to slavery, she'd probably be arranged to marry some old dude at best (starless aside, she is pretty) or probably forced by her own parents to sell herself at worst once she grew into a young woman. There was no good future waiting for her there after her only ally Louver was murdered.