As far as I know, his memories about Shirogane and Masaru didn't return yet, since that incident with Masaru kidnapping until now. In fact. it's even worse because of everything that happened in Midnight Circus before. If Narumi still retain his memory about Shirogane, then the moment when he saw the fake Francine in that desert would be shaken him.
The key person that may will connect Narumi with Shirogane and Masaru is Guy, but that guy was also busy train Masaru in puppetry to prepare him to fight Faceless' cronies (well, considering most of the Shirogane already died in Midnight Circus, they practically lacking manpower to fight Faceless). Guy is the only person that knows all the story from start till now to clear Narumi's misunderstanding.