Perhaps the room itself is magical. Whoever lives there is perceived as the "lover" of random sexy women who get summoned every night. Possibly some kind of Incubus curse or something? The real estate agent was like a spirit of the room whose only job is to keep it full.
The last guy probably died when a Yandere showed up and found out about the other women somehow.