by gravel, I hope you mean Dense Grade or 3/4 minus. If it isn't anything you can pack tightly, whatever fine material you use on top will just fall through the cracks. I haven't built my patio yet, but I plan on packing some DG and then laying a fine course of sand to fine tune the leveling. I used just straight DG to level my retaining wall. PACK PACK PACK!!!