It's not that the scythe isn't good. In fact, it's got really good effects like higher crit rate and reduce enemy MP on hit.
The manga left out a bit of Kalos's explanation here. It's because several of the Magic Swordsman skills can only be cast while using a sword. If Kalos didn't lend Hilde...