While the romance between Komi and Tadano is an important theme, this series has always been about more than romance, and is set apart from other series principally by its other theme — that of seeing the virtue in people who normally face social rejection for their eccentricities.
Isagi is, so far, really the most definitive character. Any reader who wants this character to go away hasn't understood the primary theme of the series at all. Isagi is different in a way that brings a huge social cost to her. She's also utterly committed, at each moment, to doing the right thing.