Ryuji reaction to letting go of only daughter to a person who's 20 years older is understandable, moreover they a part of their feelings have little in common, Haruhi is more of physical worker and Nagato finesse so most likely who will inherit his company will be Haruhi, which is also probably why Ryuji is opposed to their marriage.
Seems like Hibiki didn't tell the whole story, cowardly, ashamed or both, neither Ryuji or family knows and suspects he only was turned down, that's why he's brooding around.
I do understand Hibiki is Haruhi childhood friend and treat him like a brother, but after lying like that to Ryuji and making her remember being almost raped through restraining, still being caring for his wellness is really out of place since he didn't even honestly apologize.
Also, thought Aya knew Nagato and Haruhi were already married? Or she thought they're just in weird relationship so that's why she tried to test his true intentions... either way I'm not blaming her, it's still kinda weird if you don't see them together.
Thanks for the scanlation!