Don't be dissuaded by the low score, this is a very enjoyable manga if you can bear through the stupid parts.
MC is a hilarious self deprecating idiot and a massive pervert but doesn't physically harass any of the female characters. "All" of the ecchi in this manga comes from delusions in his mind.
One of the girls is the stereotypical clingy type and is very obnoxious whenever she appears, this is probably the worst aspect of the manga in my opinion.
The entire set up of the show reminds me of Bokutachi: We Never Learn, except that the MC actually has a definitive love interest.
Verdict: Way better than other manga I've seen on this website rated higher
~Read up to Chapter 147