I can't see dad as the bad guy here, even in context the fact that an old man wants to keep meeting with an elementary school kid is questionable. We know this is a fluffy manga so nothing bad will happen, but if this happened in real life then the cops would have been involved long ago.