Hmm I think from this I understand why Gyari doesn't like Iruma. Iruma by his very nature isn't greedy and at the start of the story he just flowed along to survive, only recently is he starting to develop his own desires.
Basically I think Gyari doesn't like non-greedy people.
Also that love confession