There are a lot of potential complicating factors and questions here. First of all I'm not sure I'm visualizing exactly what you're doing. It sounds like you're almost building your retaining wall on top of your drainage ditch (tile), or at least very near it. The surface around your drainage tile is most certainly going to move over the years. So I hope your wall is flexible or has a very good foundation.
The size of your drainage pipe would be determined by your expected runoff, which will be determined by expected precipitation, slope, soils, and surface cover. Unless there is some reason to do otherwise, I usually design for the 2-year, 24-hour rain event. However, this might be over thinking the issue. Unless you've got a big contributing area (the area upstream of your site), or get very heavy rains, the 4-inch drainage pipe from the BORG is probably more than adequate. If you're expecting big flows, you might need something bigger.
I personally don't care for the sleeved pipe. But it's value, and landscape fabrics value, are dependent on your soil type and vegetative cover. If you get some good grass growing on the site, and have a good gravel over the drainage tile, you shouldn't be moving a lot of sediment into the pipe. Just make sure your rock is clean. The riskiest time is right after you lay the pipe when there is a lot of available loose sediment. The sleeves tend to plug up somewhat during the first flush and slow the whole system down forever. Just make sure that your pipe has a good place to drain and enough slope to keep things flowing, and any sediment that gets into the pipe should flush out OK. I might reconsider this though if you've got really silty soils. Silt is really hard to keep from moving. Some of the landscaping guys might disagree with not using the landscape fabric. I generally focus on water flow. I'm not really good at growing things.
I will often put a layer of compost, or compost/peat moss mix on top of the rock. It usually has a pretty high infiltration rate and a lot of nutrients to help get grass growing quickly. However if you live somewhere with soils that drain well and have high organic content, that may not be necessary.
I hope that helps!