If the little stones will prevent erosion the drain can go close to either. What we don't want to see is undercutting of the soil along the patio edge. For a long time grassy waterways have been used for water drainage. What will work to our satisfaction is often dictated by velocity.