I feel like the lack of the inner monologues is affecting how the ML looks lol Yes, hes starting to like her, but in the novel he's confused about this too. At first, he's only interested in meeting her fast because he's curious about how she knew everything that would happen to his marriage candidates, and then he was curious about her plan and wanted to know more. He kept increasing the touch because he feels disgust whenever he touches a person, but with FL he was fine. And then he doesn't understand she rejects his touch because she knows of his condition (literally no one knows), so he assumes she dislikes him, so he trusts that she has indeed changed, which in turn makes him more comfortable with her. He takes time to realize he likes her himself.
Because he trusts she's not the same anymore, and because he's curious about her plan and curious about feeling okay with touching her, they end up spending more time together and develop their feelings. I feel the manhwa does him a bit dirty