These Ghouls are very good-natured. They don't seem to have any animosity against the rape-children at all. Usually the ones forced to birth them are connecting the trauma, especially the person they were raped by, with these children and are at least somewhat hostile towards them.
Hating the Ghouls seems to be almost entirely based on that religion. Just another reason to hate that jerk ass god I guess...
Though, the kidnappings didn't help. If that becomes unnecessary, there really isn't any reason to hate them.