I thinks it's normal that you are reluctant to meet people who you have a bad relationship with.
Back in chapter in chapter 45 the guild master wanted him show his spirit magic but because of the masters shitty attitude Mc decided that it wasn't worth it.
You will be reminded in the next chapter...