Mine has also done that since new. (When creeping, having to push the opposite pedal to stop it). It is more pronounced in low range. Also when driving along the pedal is very slow to come fully up when you remove your foot from the pedal. That tendency is more pronounced in high range. I have learned to live with these characteristics so it doesn't bother me much.
Another odd thing is that if you are buzzing along using the cruise control and disengage the cruise control (by touching the brakes or pushing the cruise control button); the hydrostat pedal suddenly jumps fully up, the tractor comes to a screeching halt, almost throwing me through the windshield. I have also conditioned myself to keep my foot on hydrostat pedal when disengaging the cruise control.
I have also conditioned myself, when starting from a stop (particularly in high range) to push the pedal ever so lightly, like I have an egg between my foot and the pedal that I don't want to crush. If you push the pedal too hard, the pedal goes down even further on its own, the tractor lurches forward and stalls the engine unless it has a lot of throttle.
Again, I quickly got use to all these characteristics and they just don't bother me. It is part of learning the personality of your tractor. I do fine work with positioning of the tractor all the time and I don't really find it to be a handicap or dangerous. But if some one else gets in my tractor to drive it, they may find these hydrostat characteristics a little annoying, depending on the person.
One thing I do like to do when doing fine positioning like attaching implements (on any tractor, not just my Branson) is to keep the emergency brake 3/4 engaged while positioning so as to stop any hydrostat creep or to prevent the tractor from rolling either direction via gravity. I can lightly push the hydrostat pedal when the emergency brake is on and move only a fraction of an inch very safely and precise.
I have talked to my dealer about these characteristics. He said that is just how the earlier 4720 series hydrostats work, but the newer ones are much less that way. Mine was made in 2016. How old is your 4720?