@cryum
Chapter 52 page 20 the Narahate mention they used to be "challengers of the Abyss"
Chapter 51 at the end Vueko mentions "all the visitors"
and Chapter 40 page 23 and 24 when Majkajya is explaing the Narahate he says they were all people who challenged the abyss but gave up.
Considering all the delving gear in the market, and Wazukyan's mention that the village is 150 years old (in 6th layer time, which is likely many hundreds if not thousands in surface time), and all those sources mentioned above
The villagers who weren't part of the suicide corps are just delvers who decided to "settle" in the city. Giving their body to the village like seen when Belafu gave himself to the village in chapter 51.
Maybe some did it out of desperation, maybe some liked the village, maybe some were temlted by the whole "form of your desire" thing when becoming Narahate.