Okay it seem the author forgot about the subplot of the Marca people being a slave race that is looked down upon by general society. Ritsu seems to be at liberty to say whatever he feels to whomever he wants without any social repercussions. Most of the retorts seem to be "you kids better not get in our way" instead of "why is a Marca talking back to us in the first place". Maybe he will revisit it in the future, but it seems it was left behind once Ritsu was accepted as a servant.