The comment section for this manga used to be misogynistic sludge, but I guess those folks finally stopped reading/commenting.
I like that he legit wants to sleep w/ her (b/c there's no backstory/characterization stopping him from doing so) and what's holding him back is that he's decent and so is waiting for her to be really ready.
Is it
Meguro-san wa Hajimete Ja Nai?