Light's fast enough it can go from one pole to the other in less time than it takes your eyes to send what they detect along the optical nerve then for your brain to figure out what's happening.
The whole "everything we perceive is delayed" convo is a fun discussion for sound which is super slow and we can detect the discrepancies (echo, lightning, …) but for light it's largely just an intelectual exercise. (untill you start looking at the stars)
I mean it's also relevant on earth, in terms of communication systems, with long distances affecting latency in very meaningful ways. =)
Edit: Had to check that a bit, light takes about 67 ms to go from pole to pole, brains can respond to light stimuli in 13 ms in some conditions. I have reached about 170 ms average across 5 clicks on humanbenchmark.com, 140 ms fastest, a buddy clocked 110-120 ms consistently. That's also with display input lag (in my case around 8-10 ms), mouse input lag, and of course the brain not only registering the change, but also sending a command to the finger and the finger actually clicking the button.
I think they are both on the same order of magnitude. =)
This is not to dismis your point of anything, just got me thinking, hehe.