Wild speculation, what if this timeline is actually just another Shadow World that he need to clear? After all, shadow world was an event in history that needed to be fixed, just like going back in time, which happened to him right now.
I think it'd still make a perfect sense.
But I guess it's like saying that all Naruto's journey to become hokage was actually happened in his dream.