I see. I guess him being the only relative left, the Nikaido grandpa would like Eiji to be the successor instead of the Aoi's family's successor. At least that's what I inferred from the grandpa's last line.
If this is the case, I can quite understand the grandpa. I would prefer this is the reason instead of just wanting to inflict pain/suffering.