That continent doesn't seem that far if they can get by boat there in 3 days, looking at their ship. This doesn't mean anything, I just wanted to mention it since boat travels on the Age of Sail would take some months.
Yeah, there's that breeze the spirit gave him but I don't think it would be enough to shorten the time to 3 days. Who knows, maybe the distance is just that short.