When you start to think about the actually biological reasons for the difference's in the sexes then works like this break down.Does sex hormones work differently in this world too? Like men get muscles easier because of testosterone. Is it switched so oestrogen works more in that favor or something?
Though when you think about it if all your doing is swapping reproductive organs what would the point be?