Following them might not be a wise idea.

[He sure didn't miss that bit in the bulletin about people dying and then Rastus being annoyed with them for going out on the lake.]

The building supplies are anyone's guess. I suppose they could be expanding whatever structure they live in. Repairs, perhaps. Which is what I expect the lanterns are for. Spare parts. The creature in the church probably can't reach them down there.