For rocks, a good scrubbing in soapy water should do, as long as it's not a very porous type of rock.

For wood, I'd say bake it in the oven at about 250F for an hour or so. That should kill any unwanted critters in it.