The PVC is great for wet areas!!! The only thing you need to worry about is that it doesn't have any real strength to it, so you need to attach it to something solid. A fascia should have solid wood behind it for strength to support it. For the gutters, you will need to go all the way through the PVC to secure them. Be sure the flashing is good so no water can get behind it and you shouldn't have any more issues. I use James Hardie 1x6's for my fascia for the same reason, with the same considerations. The advantage PVC has is that if the paint comes off, you don't have to worry about it rotting. If the Hardie is exposed to a lot of moisture without any paint, mold will grow on it and it begins to break down.
Use good quality exterior deck screws to attach it, then clean up the edges of the hole from countersinking the screw with a razor or chisel and fill with a quality caulking or exterior putty before painting.
Eddie