I read this before in the LN, but seeing it again makes it really clear what a shitty maneuver this was. Harold saved those people via a secret note, which meant he didn't want his actions known back home... so they used his desire for secrecy against him to get their way and install the girl. What gratitude! Truly, no good deed goes unpunished.