It will depend mostly on what you expect to be doing with it. You could notice the difference on pto-driven attachments, for example, where a 40-ish hp tractor would comfortably drive a 6 ft. bush hog and the 35 hp machine might struggle in some situations doing the same thing. You'd probably not notice any difference mowing light material on smooth, level ground. Going uphill in thick brush... you're going to want the bigger herd of ponies up front.
Exaamples of other attachments where horsepower makes a difference: tiller, logging winch, snowblower, powered landscaping attachments... anything where a long, steady load on the engine occurs. Similarly, pulling a plow or disc, etc. across a field demands steady power.
For other things - lifting and carrying things, pulling someone out of a snowbank, grading a driveway, etc. - you're limited more by available traction than you are by available power, so you'll spin the wheels before the engine stalls.
The 4060 also moves you up to a more powerful front end loader that lifts more and digs better. Depending on what you're doing, that can also be important.