The average rating is used in search results when sorting by quality
Users see an Unloved Manga (current rating 6.17) and try to shift it towards the score it deserves (6.5?) by leaving an extreme rating of 1 or 10.
I guess extreme opinions work the same way in the comment section.