It's more like Musashi envisioned this battle as an endless banquet to feed his lust for combat, but now that he's actually about to face Baki, it's like there's nothing for him to eat. There is nothing for him to gain in this fight, because he's going to die.