Beside the table being a bit too big, they also prepared plate and rice for the empty chair in which people don't usually do (on page 7) in which the Ancestor also realized.
Their memory probably get repressed / altered / sealed, but the parents still instinctively knew to make that amount of...