There's no way he can have a quiet life if he stays there in Morioh. I guess the best thing he can do is killing Hayato and his 'wife' then fleeing the town.
I like how the villains don't completely disappear from the story after losing in DiU. This dude was a minor villain like 50 chapters ago and he's still around.