@AbyssalMonkey no dude, I am serious when I say every stage of development, you see a couple twigs tied together, then a square frame, and on and on. Some games make you pay the material costs as the building goes up, so you can run out in the middle, with the walls framed out, but not standing.
Also I would think that the montage of his pocket settlement growing and changing, would be a pretty good explanation.