Their can still wipe humanity out so the stake is there, plus this manga might go the route "they hold too much power for us to ignore"
The fog that time was just come to being, before that they were acting solely on admirality code and didnt actively sought an enemy. Latter on, when their...