I tend to think that Hiromi cares about Anju and realizes that she's really struggling mentally and emotionally, and it's making her irrational. He's not interested in punishing her, just in getting her to stop, as much for her sake as his. It's generally in keeping with what we've seen of his character since the very beginning of the series: he's extremely selfless and forms strong attachments to the people around him and cares about their long-term happiness.
Of course, he has no idea yet that she's sabotaged his relationship with Nonoka, so we'll see how that plays out.
Overall, I've really enjoyed this arc and how Anju has significantly matured; it feels like the perfect balance. Her arc of dropping papakatsu and moving forward with a career were about fixing how she relates to herself; now she's fixing how she relates to others. The scene with her mother, in particular, was great: a strong indication of how Anju is becoming less self-centered and able to see how her mom is wounded and suffering herself, rather than focusing only on the suffering she inflicted to her child.
Sasuga is far from flawless, but one thing I really enjoy about her work is the deep investment into allowing her characters to change and grow as people instead of slotting them into fixed archetypal roles to keep the status quo intact. This arc was a perfect demonstration of her writing at its best.