Yeah, but loyalty is one thing, knowing when not to continue doing things that will absolutely stress your SO out is another. He knows Chiyo is paranoid about other women and has trust issues, he's gotta learn to think before acting a bit more.
And this will absolutely without a doubt get back to her, because it's a romcom and that's how romcoms do