I mean men can still have kids pretty late, so it's not impossible that grandpa had a new kid (possibly out of wedlock) and then to hide the shame they gave it to their son and told him to raise it alongside their son.
Though depending on the grandparent ages, if they are "relatively" young...