The flashback was hilariously bad. It actually made me laugh after seeing him cry. Also, what the fuck are goblins doing in the middle of a desert? It feels like the author didn't even try thinking what kind of monster would fit a desert, they just went "fantasy = goblins, obviously."
There are some things I liked, though. I loved him having conversations with the camel, and I liked friendly ants. Though, I already know the ant queen will have a humanoid form, and will obviously be a part of the harem. Also, TIL "ant honey" is actually a thing (had to look it up first, though, it sounded rather ridiculous).
Btw, I already have an idea for a next banishment-type manga. A cum-bender gets banished to the sea of semen, where he'll help all the seamen in catching sperm whales.