The family chapters establish a base of who he is, how he acts, why he acts that way, why he has the skills he has, his morality, everything. They were very important and it's really nice to see a manga actually focus on the main character and their development rather than have them be some blank slate who can do anything so the reader can feel like a genius badass when they self insert.