Oh this manga kinda reminded me of it because it's a main couple and they're doing fantasy things, very wholesome. But since you follow it already there's not much for me to say.
For others though, their village slowly expands with more people, it's not a harem, they also make many friendships...