Hah, I just made the same comment on the previous chapter.
Looking back at Chapter 1 it says:
"You can go through the gate anytime you want.
You can open the dimensional gate at a new place, but... you can do that only 2 times on each side, thus 4 total"
At first I thought he could only go...