Oh, yeah, Liquid Nails (I'd suggest PL500) polyurethane construction adhesive. Clean off the loose stuff, wet it down, apply, and wait.
You'll have to break the rock to remove it.
They use that stuff for the top row of blocks on walls. I've glued 2x4s to a concrete floor and lifted piece of the slab up when I tried to remove the 2x4 /forums/images/graemlins/cool.gif