[ Sora straight up crouches, arms on his knees and chin on his arms, really thinking about it, trying to gauge this girl's age and understanding of what she's reading. ]

Well, they could, but are they gonna ask? The baby can't tell what's going on, so they can't tell the goblins to go away if they're scared. The goblins need to ask permission from the baby's parents if they want to hold them.