I mean, even if they aren't refuting it, they aren't actively pursuing it either.
It's a level of ambivalence about the matter rather than jealousy or other such feelings.
I wouldn't worry about it impacting the story in the long term.
unless this does end up being a "must do XYZ to leave"...