One thing i will say, since the family wasn't explained further in much detail, and afaik so far they haven't been in the future chapters and volumes, so this is only speculation, but there is a real possibility that the four sons aren't actually mimihiko's kids and they were actually some of the enemies of his wife