I have this feeling that because Griffith looks and "acts" like, well, Griffith, Caska will go with him because her mind hasn't fully recovered and, as he is "normal", she'll cling to that normality.
Giving Guts all the more reason to kill him and come off as the bad guy some more. Because we can't have Guts be happy, now can we?