Their reason for sticking around is, "Master isn't mean to us." They both fully understand that he isn't too bright even though they don't yet know he's illiterate. I feel like it's straining disbelief a little. They clearly need each other (without the elf no food, and without the dwarf, no...