Yeah, he definitely meant his “chastity” as he has one legal wife (Su Ying) and one concubine (Liu Zhi). Su Ying is still a lady of standing with many assets, whereas Liu Zhi is a fallen noble and treated as property. This is why she can’t become his wife, just like Ying’s stepmother couldn’t inherit her father’s fortune.