Welcome to TBN. Yours is a common "concern" with most new tractors. Be careful - don't push/pull so hard on that handle that you break something. Try shifting as you are VERY SLOWLY rolling backwards. Try shifting as you roll backwards with the tractor in neutral. Try shifting while rolling backwards with the tractor in 2WD.
With time and use it will loosen up. My M6040 is 14 years old. There are still times when changing range is difficult. Be patient - this will improve.
Both my M9's act the same way and one has 4000 hours and the other 6000+. I have to rock the tractor or cut the wheels side to side to engage or disengage it.