I mean, it is a fun theory, but he'd have to have been raped when asleep or something, while no ghosts watched over him. In the second chapter they joke about him being a cherry boy/virgin. It could still be true, but runs into a rather large plot hole of the setup. Or a similar set of...