i feel like people ignore a few things about the protag, people seem to have trouble reading expressions and misunderstanding what the protag says/feels.
Go back to chapter 4 and read from page 17 on, he cares about them, but, he is really in love with his main girl.
ch4 pg 19, pg 24 and pg 28...