I think the only time I read it as such was on an isekai manga for someone's name. Otherwise, it's always "hitori", and the kanji sound added to the end always changes (hito -> bito).