The gargoyle is hundreds of years old and sleeping most of the time, even for years continuously if given a chance, I reckon. So, if the village had been more peaceful, it would have been entirely possible for it so see Tiel first as a little kid and the next time it wakes up, Tiel could have been a 40 years old woman. As it is, I imagine it didn't even wake up the vast majority of times Tiel visited the "shrine" to clean the grounds. That wouldn't be much of a life for a lolicon.