@urmumske yes they can, they just can't cast with them. barbarians can, and do, use everything as a weapon remember, even a fish does 1d4 if you throw it as an improvised weapon