The Raws says:
"しょうがない じゃないか
元々小さい種族 なんだし-!"
Romanji:
"Shouganai janaika
Motomoto chisaishuzoku nandashi-!"
種 (shu) - species, kind, class, variety, seed
族 (zoku) - tribe, family
Which roughly translates to:
"It can't be helped.
We're a small Species/kind/tribe to begin with"
Our group also...