I feel like it's a mix of that and some kinda self confidence issue cus like the guy says What good would it do to fall in love with someone like me. And the way he denies her love vehemently also kinda enforces that and then theres also the last page where he thinks what good would it be to get...
You know it could be fun if the MC was actually the trash little brother where we get to see him get a trash skill that actually remains trash unless he changes his way of viewing his skill with his personality changing slowly overtime.
Instead we get the classic good guy getting a trash skill...