I don't think he was making unfair assumptions about his parents. It seemed like they thought he was too much trouble to deal with and sent him off so he wouldn't annoy them anymore. How else is a small child supposed to feel about their birth parents dumping him off to somebody else?