As the new number 1 demon, obviously Jahy should be receiving gem tributes from her subordinates instead of simply hunting them all down herself. Or at least that's the bullshit I would've hit Druj with by now in Jahy's shoes. It sounds perfectly plausible, they need to bring all of these things to one location eventually to make proper use of them anyway.
I feel like a more likely scenario here is eventually Druj finds out the truth and it'll either be a case where she offers to help Jahy, but pride makes Jahy say no... or given how the demon society seemed to work, Druj is the new boss and will happily assert her dominance on the person who treated her so "well."