Damn, that's such a nice twist to the formula. I was honestly ready to embrace the slightly clichéd "Oh noooo, they were moving real people as chess pieces all along!", and it wouldn't have been too bad?
But reliving the parts of your past adventures and inheriting the will of your pieces sounds much more charming for some reason.