To be fair, this manga is medieval in setting. Marrying, or in this case concubining, a child isn't too bizarre for nobility. He never said he was going to do anything... specifically untoward, but I wouldn't put it past him. Again though, nobility, historically, can get pretty weird, to put it...