Not all of them do, but the ones who don't usually have nothing to come back to. So even with that world being less convenient, it's more home to them than our world. Honestly it's clear she doesn't really want to return, she just needs to voice it to him but is too scared to shift the equilibrium.