Yes it's filler, but it might've been its own oneshot story had it been longer, and definitely better compared to the main story post-timeskip (it really went downhill after Hanazono went mad and vanished).
This manga is just too unbelievably heartbreaking.
Take a whole chapter away from our MCs to tell a completely unrelated tragic love story. So much pain in this world.