Hmm, maybe because I read the mtl of the novel, but I felt like the conversation between Kazama and Fujibayashi was different here.
Back then, I was under the impression that they seriously wanted to abandon Tatsuya, and Fujibayashi hold a grudge about the death of Erika's brother.
But it seems like they, especially Fujibayashi, was simply concerned about his future.
Other than that, I find it weird that they made Saegusa brother to be so silly.