First-Shouldn't have allowed him to push you aside. You don't have to bark at him, just stand your ground as socially acceptable as it is allowed.
Second-Don't agree to contest with Subjective Goals. Your society is geared to favor and recognize him just because of his position, they would applaud just for the sake of flattery and not being mistaken for insulting his family. Unless what you want is his own validation in particular, over your girl friend, never agree to a contest that is only winnable by the enemies opinion.