Sadly the only way to turn this around would be for him to say "sorry I was just trying to see everything your sword could do", pwn her like the Boring Swordsman isekai, then say "as per the terms of our duel, come to my room tonight in your bra and panties".