I believe in the raws, he says when he makes a second gem, the first one disappears.
And when he breaks the gem, he will return to the time of making it. He says in the panel that with his finger pointing at the table that "in order words, if I break this I will return to here and now" (since he...