[user1007]

If you can afford it, I would compact and level the gravel and thin float your pavers on an inch or so of leveled river washed sand.