The demon side makes me think it's just a criminal gang, not a whole realm of demons. Apparently their battle prowess heavily depended on one man arranging everything. That's not fitting for a country. With such incompetence in leadership, the demon country should collapse internally very soon, without the humans needing to do anything. Well, should, but I guess it won't and this is just the mangaka depicting it all quite haphazardly.