No matter how many times man-baby gets abused or told off, he's never going to leave. At this point it's going to take him dying for him to be gone, but since way earlier in the manga he jumped down from a building window and wasn't injured, that would be difficult.