I had a concrete patio poured in my backyard. Around the border is a small trench. I filled one side of the patio trench with dirt. I would like to fill one side of the patio trench with small rocks that I have in my backyard. Would that cause a problem?