The novel explains the button ordeal better but moral of the story he has no memories of what happened while he was in there besides his practice with the sword, so that's why he acts the way he does and still seems mentally immature in many aspects (he is exact same as when he went in except...
These character are so dumb, especially those gold diggers. Who cares about servant bloodline since all of them are so obsessed with status doesn't he have it since he has connections with the association.
smh -_-