If he were regular family I'd understand, but he isn't. Hinata left home and clearly doesn't like interacting with him, attending the Ibuki meetings and doesn't want him getting close to her and Naori. Personally I wouldn't want to rely on a person I don't like, especially when they're going to...