I have a feeling all of you and our heroine are misunderstanding him. Remember Eddy was very in love with the younger Philomena, and it had nothing to do with her looks, it as about her attitude toward him. The fact that she went running to him on his return, shows that she hasn't changed. I'm guessing that is what he means.
On a different note, didn't Philomena go to school?