If the 2 shmuks and 1 gardening tool plus that Saint girl end up like in one other manga - where "goblin slayer" event triggered, 1 dude died insta IIRC, other got mutated cause of some shady items he had, one girl got caught and well forcefully got "gang pleasured", and the only decent girl survived thou required a rescue mission, but then joined the harem. Then this could be OKish manga.
Thou the "decent girl survived" would depend on if the Saint is actually a bitch, or just your typical shy idiot who want to fit to the "crowd" - aka were her reactions indicative of someone who is good, but behaved badly to "fit" the majority. Or is she just as evil as the other 3. Either way - make her survive, not need her joining the harem, or join the other girl in the "gang forced party" - depending if she good or not.
Also, if he magically levels to 95 cause he killed a single mob, for getting OP as fuck, couldn't they just use the "heal up on level up" mechanic that a lot of games have XD? Why waste healing items hehe.