If you're the strongest in town (or the country, or the world, etc) then everyone you beat is going to be weaker than you. Plus, if we're going with manga "rules", often times there are little old men that kick most everyone's ass in these sort of tournaments. This argument of "oh you're only targeting weak dudes, therefore you're evil" is silly.