I sincerely can't believe someone who gets tossed in a sword and magic world who can learn magic would refuse it(assuming you don't have to get cloistered for it anyway). Even if it's just for selfish things to make your life easier like instant cleaning or telekinesis so you don't have to get out of bed or mind reading/status scan if you're the cautious/paranoid type.