Its so dam cold at night. Going in full armor, even if they didnt need to swim, their stamina would be shot due to the shivering and armor. This group did do hardcore stuff before, scaling that vertical cliff at phenocia. But that was more bravery since they were originally a mountaineer-type army with loads of mountain warefare experience.