I think I haven't conveyed properly I'm not saying he is a bad person when I said he only thinks about himself and some people has taken this very badly (not necessarily you did, I think, but I'm using this comment as an example, this is not an answer directly to you per se), that's why I said in another comment it doesn't matter to me if it's out of selfishness, obliviousness, preservation or whatever, his actions show this.
Before I was in the same boat of "we don't really know because there isn't his pov" but the more things go on, it's more clear to me he doesn't think much of others regardless of external happenings. Is a justification for his failed confession being jolted by his previous encounter with Yami and being nervous of the moment? Maybe, we don't know, but the fact is he still went on when alarms were going off with Hikari. Whenever you want to think he is bad or just or a victim of circumstance, I don't think it really matters.