I like the theory where he's a widower or a divorcee. To me it explains a lot of how he acts, especially if he's a widower.
Like here, we can see the signs of deeper feelings, but someone that's taken the kind of damage losing a wife would cause might not make the connections. Either by...