Correct me if I'm wrong, but, wouldn't the memories of his future self be useless after his first changing of events, as it would make a completely different future?
Author-san the timeline is not a novel that doesn't change depending on the choices you make, unless you prescribe to all these "Fixed" events that are pre-determined, and then what is the point of doing anything if you can't change the future?