Let's see... Kishi-san first appeared in bloody chapter 8 i believe, and since that was back when the chapters were only a couple pages long, that might very well have been the first or second issue of the manga. But she never had her own episode which is probably why not everyone noticed her...