@Nakanowatari A bunch of people want the protagonist. The old guy that fought off the perverted monk is a charm master who's looking for a new disciple (apparently talented charm masters are incredibly rare), the eunuch that greeted the Prince and Fourth Princess wants the protagonist to work under the Emperor because of his skillful writing (protag left a poem in a study room at the palace) and I don't remember who the blonde haired bearded guy...
Basically, after learning of his talent, every one wants the main character for themselves. Huge turn around since he was regarded as useless before.