I wouldn't say he left him on his own since during the flashback when the stuff with the Earl was going on and a bit before Cross stopped it, we saw apocrypha doing something to make the Earl lose control (he was doing something, can't remember exactly what) so I would say he was doing stuff...