Nah, walking in on their physical abuse would be more than enough reason to remove them completely. Nothing for the emperor to notice, apart from having stupid spies. Letting them stay to observe, but never get close, would be giving them way too much grace, even in a situation where you don't...