I get by pretty well using my tractor (Deere 1025r) for mowing as well as loader/backhoe work. It is a pretty good compromise in my opinion. I don't want two units to maintain and store.
The backhoe, loader and mower are all very easy to attach/ detach.
This playlist shows in pretty good detail how easy it is to switch:
John Deere 1�25R The Ultimate Transformer Toy - YouTube
Any larger tractor begins to cost you a lot in turning radius. I'm not sure that it will cost much in compaction or ruts, etc because the tires are larger, distributing the weight better.
The Deere or new Kubota BX (23s) both have very easy 'attachability'.
This is very important for me.
Hope this helps.
Tim