It seems our Hero/ine resolves to be the rich man and plan to take over the dukedom estate right after this time, for her/his maid who only want to marry rich and handsome man...
Honestly in that situation I would have taken that as "What, you say you're not thinking of marrying, why should I have to either?" in the more general sense.