Yes, to an extent. Basically, depends on are special powers common or luxury of the few chosen individuals. If everyone can use telekinesis to lift boulders and become living construction engines, then the feasibility rating is much more forgiving. However, such things must be somewhat common place then. Even if Bob the wizard could technically build the mage tower of infinite height alone, would he, is essentially the question then.
One thing I rarely properly address is how they actually defend against magic and magical beings. Fireballs and explosion spells are essentially cannons and artillery, this should affect the design of walls and other defenses. If not the shape, then atleast there should be wards and barriers in place and so on. Additionally, many fantasy worlds have to tackle with flight way earlier than us. Where are their sky defenses against flying creatures, air drop spells and so on. Since most authors ignore such things and just slap fantasy elements on essentially a snap shot collage of history, I rarely nitpick and address them too. Unless it is clearly obvious they should be, ie. the setting constantly having flying monsters attack cities with nothing being done about it.
In short, if it seems that they can in the setting build fantastical things, then they are allowed to exist with no explanation given. However, if it doesn't seem like they have magitech to allow it, neither will I. Though, some things are too outrageous to accept no matter what.