I just realized. The black mage is likely the mage that served the first concubine and was her lover. Since we know that mage did not die, had silver hair, and would have a grudge on the Empire that took away his princess. As such, he delved into black magic and is plotting revenge, years later.