If you think about it, his family, logically, shouldn't anymore want Xiao Yan to marry a really important person. It would equal to making Xiao Yan an even greater public laughing stock, thus affecting the reputation of the whole family, even the clan. But I suppose there are different ways to look at it.