That's the sort of reason why I think telepathy would be a really troublesome power. An example I've used before: Imagine driving a car in heavy, fast traffic. Now imagine that everyone else's road rage is intruding on your thoughts, plus their startle responses from abrupt stops, etc. It'd be really dangerous to drive under those distracting conditions.