I don't see how the problem can be in the cylinder. Think about the loader control valve for a moment. Until you move the levers, the control valve is simply an on/off switch in the OFF position. In that OFF position with the the levers sitting in the neutral center position the control valve blocks all flow to and from the cylinders.
Now picture the cylinders. In order for the loader arms to drift down , the lift cylinders have to become shorter, which they can only do by forcing fluid that should be trapped inside the cylinders to go somewhere else. Without a leakage path through the control valve and back to the sump, the lift cylinders cannot shorten and the loader arms cannot drift down.
It won't hurt to look at the cylinders and do some tests, but I think you should also look at the loader control valve. If it is the type of control valve that has a built-in relief valve then that is where I would look first.
rScotty