Hmmm... I think his goal is to instil inferiority I the twins, "this was the empress, noble regal beautiful and very loved by the emperor, he must also love the children with her a lot more than bastards from some random woman"
It's easier to manipulate them if they feel inferiority to the...