If you have shoddy wiring in your house, you might get current on the outlet's ground wire. It won't affect anything generally, but it can give you a good shock when you touch back of your PC with one hand while holding some other properly-grounded conductor with other hand.
Also check this...