(As someone who hasn't read the other chapters) TBH I'd say its more likely one of them is misremembering things or the scene from Tomoya's memory is incomplete, given how Tomoya omits the line about promising.
If I could make a bet, Tomoya's probably the unreliable of the two narrators given how much he was repressing himself over his life. But... we shall see