Although even if he's treated Freya badly, he might still have started to care for her now in some kind of Stockholm Syndrome way. (Even if he is the crook, the fact remains that the "whole world is against them" and they are being pressured, and however willingly she is still an "ally", and the feeling of "shared peril" is a big trigger of Stockholm Syndrome)