Threads about how to paint PVC seem to come up often. I honestly did not know you could stain it any color until I read this how to piece. The stain is permanent and actually etches into the PVC. It seems an excellent alternative to painting for at least some applications.
I have had success using a plastic primer (Rustoleum) or plastic paint (Krylon Fusion or Rustoleum) to a point too though.