It being Yani definitely makes it alright. I mean, Yaku is at least trying to get her life together, so fantasizing about her feels wrong, on a spiritual level.
Yani is so spiritually dirty that you'd probably be reducing her negative karma a bit by fantasizing about her, tbh