The announcement about the death threats on scanlators for no delays is disgusting and ridiculous. It shouldn't be a thing... But sadly, a thread in announcements won't be the end of it. I'm not sure if these threats were mostly made via mangadex's messages, but if they were, could we have a system to attempt to detect all private messages that might be death threats?
My idea would be to first trim and clean the message, run it against some patterns threat messages would have and put it in a To review list if its "threat score" is above a certain threshold and let a human have the final say on it. I'd let the message appear to be correctly sent but never send it to its recipient if it might be a death threat. It's not all that bad to have false positives, but false negatives are a problem so better safe than sorry
My idea would be to first trim and clean the message, run it against some patterns threat messages would have and put it in a To review list if its "threat score" is above a certain threshold and let a human have the final say on it. I'd let the message appear to be correctly sent but never send it to its recipient if it might be a death threat. It's not all that bad to have false positives, but false negatives are a problem so better safe than sorry