I wouldn't overanalyze the physics. The point of the reveal is simply that the mansion wasn't haunted. The precise mechanics of the wind explanation are less important than its function in the story, and that is to provide a plausible reason for the protagonists to obtain a huge mansion cheaply...