His ex-wife isn't necessarily in the wrong. The dude is huge. Anyone would get afraid if a guy that big started yelling and slamming the table. I'm guessing the courts in this case lump domestic abuse (in this case, intimidation) and domestic violence together, or Japan doesn't separate the two, or the writer just fudged it to make the MC more sympathetic. The guy didn't mean it, but that wouldn't have made it any less frightening for his ex-wife. It must be a pretty common occurrence if she knew that he would react that way and that she would have the opportunity to record it.
I hope he has a reflective moment where he realizes that people are gonna perceive him a certain way based on his size and build and that the story doesn't just demonize the woman for a legitimate fear. This needs a bit of maturity and nuance, given the subject matter. Not just "woman bad because woman not think about how man feel."