MC isn't totally unsure of himself here. He knows what she means to the whole community and if he's seen attaching to her it's not that he'd drag her reputation down, the town would hammer in the nail that sticks out and he'd be identified as an issue.