You have a dungeon right there, kill them, throw them in to the dungeon to get rid of evidence, forget about them. The world is now a better place.
You lived in a medieval setting for a year, I refuse to believe that you are not used to see people dying.