You see, him being reincarnated was essential to the plot, how else would it be explained that he has trouble socializing with others, but by him being an corporate slave.
There was absolutely nothing in his childhood that could've made him asocial, expecially not his father...