I was thinking that too. It's like the Davos crowd descending from their ivory towers to recruit worthy plebs from Harvard or the London School of Economics.
If the village's children become living dolls, who eventually become shadows's host, who eventually become known nobles.... wouldnt the villagers recognize at least some of their own children?