They acknowledged he was OP last chapter, he's slaughtering the entire forest this chapter, I kinda think they're just over protective rather than actually thinking he can't handle a dungeon.. And honestly, the chapter 1 ending panel makes me think it might actually be protecting something in the world rather than the child itself since we have the unresolved worry of theirs of him being reincarnated like he is.