I actually disagree, I don't think that was supposed to be awkward, it's him being smooth, at least in Japanese high schooler standards.
Key line is page 22 which is originally 俺がいないとつまんないくせに…, you could alternatively translate it as "Even though you feel dull/bored/whatever without me..."...