To be fair, he's not a good person, but... half(?) of this is an act. He's definitely a whoremonger, but he's also in the slums and whatnot for information.
It's a big mystery throughout the first volume, and when it shows how they met, a year prior, a LOT of their previous interactions start...