He isn't super smart. By taking his hand, she in effect removed the delay, making him "not alone" in that 1/300,000 second delay. And yes, the bodily delays are greater, but that's not the point.
And the writer/mangaka does show us this by first having him be alone among the stars, and then have them both together, holding hands.
Such fine storytelling!