I bet the black haired lady is his older brother turned woman by the curse of the island...
Or the more believable option, she knew his brother because he ended up in the island and was killed by the women thus traumatizing her and making her want to help other people who come to thay place.