Considering how every time Kaibara was involved it was as if Yamaoka had a blindfold on and could only see red, it seems out of character for him to give up the win like that instead of telling the brat about how his brother winning like that is meaningless.
Is this behaviour foreshadowing for something?