She met and “fell in love with” Joe very early on. Now... we know from the story that joes a real piece of work.
Womanizer? Check
Deadbeat? Check.
Jailbird? check
TroubleMagnet? Check
That, and in the arc we learn why they all got along, and how Ryuu got his “fingers into” Yuzu... she was hurting for one, and papa didn’t want Yuzu to be near Joe, much less with him , but knew it was a sensitive topic to tackle.
Nothing “sent her back’ to him”. She was always in love with him. It’d be like saying, I know Your still in love with your ex, but I want you, I’ll make you mine, and I’ll take care of you until I can wash that man out of your mind
We also learned that Ryuu doesn’t mind the occasional cheating. That said, two conditions apply.
1. It’s not Koharu
2. It’s not Koharu.
Remember, when he hare kon was being setup, and he told them. He’d take them as his hare kon wives, he ensured there was room for “at least one more” that he wanted to join them.
Joe is... ugh, I don’t know how else to say it. The one who gets the girl, looses the girl. Wins the girl back with “soft words and glowing flattery” to get what he wants then leaves. My impression anyway.
We don’t know how long he would have stayed out of jail even if Yuzu has opted to be with him.