It wasn't supposed to be. It needs to be clearly inferior to Carlos's castle. Otherwise it could be interpreted as a provocation toward a superior. Ars practically has no allies among the nobility, so while he can defend himself, it's best not to make the other nobles even more envious. In any case, if you ask me, it even isn't a castle. It's just a mansion or a very small palace.