Gunfire aren't invincible, you can't defend from someone in very close range with a sidearm, you have to struggle by yourself. Also weapons can be detected, there are many ways to spot someone armed.
Furthermore, martial arts are a form of attaining peak humanity, you get stronger, faster, smarter, you get used to pain, etc
Plus, this is a manga