Nobles are above commoners but they certainly aren't above royalty. The manager of the territory is married to the princess and the territory belongs to a prince. Even if said manager is a commoner his connections put him far above lower nobility.
Looking back at around chapter 34 he was granted...