You can get ALL of what you need done with a smaller tractor, unless we've grossly misunderstood you original post. Yes, people generally say it's better to go a bit bigger than the minimum you think you need to get your work done, but in this case, you may be looking at almost double what you really need.
There are others who can tell you more about some of the other uses, but I can tell you a bit about using a tractor in the woods. Maneuverability is just as important as total HP and weight, unless your woods bear more of a resemblance to NYC's Central Park than a real forest. There are pro loggers here who have modified 50-65 HP tractors for work in the woods, and are quite happy with them. There may not be a whole lot of them around anymore, but that's because guys with chainsaws, tractors, and skidders seem to be giving way to Feller-bunchers, harvesters and forwarders for logging in our area. That profession seems to be getting a whole lot more mechanized.
If you are setting up a tractor for real work in the woods, you'll want to get a belly pan installed, limb risers, and FOPS. Going with just ROPS is taking a real risk in the woods, though many (including me, up until recently) have done it for years. I also find a logging winch indispensable for bringing in saw logs and firewood efficiently and safely.