>Princess mention making babies in this chapter
>Previously Sarah (the mage) mention that nobles buy mage slave to give birth to a child with magic power
It is not a literal castle, they show it back in chapter 1
https://mangadex.org/chapter/655951/5
It Is just a single large building. Guessing him and the harem live on the second floor and the other people are on the first floor.