As much as I want to see Lorem kick ass i do want to see some demon(s) that can go against her as equal too, without that the weight of this arc may not feel as heavy.
At the same time, it doesn't seem that they were completely taken by force, the apartment wasn't vandalized in any way except for the door, that it was very cleanly "destroyed".