@rworld low rank nobles have very slim chance to meet with the royal family (if they have one at all). In the world where there's no television, it makes absolute sense.
This becomes more nonsensical with every chapter... he is rich, he is powerful, his ships alone could probably put the kingdom to ashes, there is just no logical reason for him to let others treat him that way...