So he never stepped foot out of that forest, where no people can live, but he fought bandits in the area when his mother was training him? Something doesn't add up, not with the information they are giving us.
I doubt any of the mom's previous partners were stronger than her, so it's a special condition just for Minato. Lilyn has high expectations what comes to her son in particular. Not that we wouldn't have known that before, with all the training and tests.