If you have to describe chemistry as "one sided" then its not chemistry. There is a sexual chemistry but the problem is, that is all that is there for Agawa which you then realized isn't anything special in a world where everyone is fucking. If Agawa was just a side piece then sure, that sexual chemistry would justify the lack of relationship process but the problem is that she isn't in the eyes of Gotou.
Calling it “no chemistry” is just redefining chemistry as “exactly the kind of relationship I personally approve of.” The chemistry is there, it is just asymmetrical at first.
Early on, the pull is mostly one-sided from Gotou, based on their time as library committee members before he even knows about her reputation. Later, the sexual chemistry is clearly mutual: she keeps wanting to sleep with him, tries to keep him away from her sister, and eventually stops seeing other guys because they do not satisfy her the way he does.
You can say you hate that kind of messy, sex-first relationship. That is fair. But it is not accurate to say “no chemistry” or “only generic sex” when the story literally shows her changing her behavior and preferences specifically for him.
Also, expecting her to suddenly build a clean, emotionally healthy relationship when she is still deeply wounded and has not had any real healing yet is asking for the impossible. She is still a broken character who is afraid of true intimacy and vulnerability, and the story is consistent with that.