I think some people have forgotten the premise of this series. You should probably read chapter 1 again.
- First off, the reason why the main character is in that world is because he's "useful to god". It's pretty obvious that his usefulness is as a breeding horse as mentioned by the elves in chapter 11 or so.
- The second thing is that the MC specifically wished for a peaceful life free from conflict, so there is never going to be a major confrontation. Just think about how upset he got at the Wyvern attack and with Hakuren's attack. Not imagine what he would do with a full scale conflict. Not going to happen.
- The third thing is that the MCs goal is just to farm. He doesn't care who lives with him as long as they don't get in the way of his farming life (which is mentioned in the first chapter).
He's pretty laid back and the only proactive thing he has actually done is to go out and look for more men to bring into the village (which he failed at doing). Most of the recruiting for the village is done by the females of the village who mainly select other females.
Ru picked up Tia and forced her to join since she couldn't handle him by herself. MC was fine with just Ru. Tia brought the Elves because they needed more help on the farm and the angles because she wanted a security force after the Wyvern. Flora brought the oni maids. The only group that was recruited that was not exclusively female were the Lizardmen who were brought on by the angels. Meanwhile the men who have traveled to the village were invited to stay, but declined.
Going over the factions:
The Elven men are presumably dead, remember their village got attacked by humans and they were scattered. That's why they go out and find additional elves every once in a while
The Vampires appear to be a mostly feminine race (succubus) since the breed with human males by charming them (although this leaves a plot hole where Ru had a male child, but we can chalk that up to the MC being immune to any type of disease which presumably also counts for his sperm).
The Angels they don't really mention, but they are likely a feminine race much like the Vampires. Tia brought them over as security guards who blame Tia for not bringing males.
The Oni Maids are servants of the Ru and Flora. If they are Succubus then it wouldn't make sense for them to have males included, but that isn't made clear so whatever.
The Beast tribe has sent over the only males they could spare (the males of age needed to defend the village and do the labor intensive jobs, the females were expendable)
The Dwarfs are all males. They say they aren't lolicons, but the elves are all 300~400 years old so how old are the dwarves? it's not made clear.
Most of the Dragons are married. I would guess that Domaim (the younger brother) could join the village. That would be one available male, Doriam certainly can't. It was made clear that his wife and Lasti would kill him without remorse. So he just visits for the drinks.
There was only one demon representative in the village until this chapter (well there are the two maids, but they don't participate), but the MC would not deny male demons access. Most of them are afraid of the village and the women are basically forced to live there by Frau since they crossed her.
So yeah the biggest problems in terms of the "plot" so far is the bachelor male dragon not joining the village (although we don't know much about him) and the demon race not sending any males to the village. It's highly likely that the Vampires and Angels would be too intimidating to the demons and the elves have already stated they are looking for the best seed so they wouldn't change partners anyway. That leaves the Oni, the Beastgirls, and the Demons for anyone else that joins the village.