In the timeline before Wagatsuma timeslipped, Kanamori would have no one to propel him to a leadership position. He probably wouldn't have the guts to extort Harumi or anyone else, which means he keeps his eye, and Harumi doesn't end up following him and succeeding/overtaking Kanamori. Instead...