I wonder if it's as simple as the "human" side are all ningen (People) while the destroyers are all mazoku (the Tribe of Evil) or some similar terms.
Japanese has a number of terms that can be inadvertently misleading when taken literally, but they also sometimes have like six different words...