When I changed my HST fluid at 50 hrs (per my manual), I didn't spring for UOA, but I did run it across filter paper in the drain pan (like I did for the engine oil). The end result looked like some metallic silver paint had been spilled on it - except heavy on the metal flakes and easy on paint. Nothing out of the ordinary, pretty minor/expected. There was a tiny chunk of something brass-like, and something soft like a remnant of a gasket or sealant material. Looking back now I wish I had cut the 2 filters open (no strainer), but I didn't... wasn't really that worried about it at the time, used the papers only cause I had 'em handy.
Point is, it wasn't all trapped in the filters, there was stuff laying in the oil in the sump. Probably either wasn't picked up, or perhaps even backwashed from one of the filters upon shutdown/drainage, who knows.
Anything getting into the pump/work circuits has to first pass through a filter, so no worries there, and that only leaves splash oil as a minor concern, of which I don't think there's typically a whole lot of splashing going on in a HST.
I still felt better with the crap out of there. I guess I'm old-school, I just like to get break-in contaminants out early (but not
too early). There is no way I could stand to wait until 400hrs, even with filter changes. I've seen instances where you change oil and not filters, but this to me is almost counter-intuitive.
Maybe it makes no difference. Maybe I'm also needing to/counting on getting a few more years out of my machines than some.

It couldn't possibly hurt to do it earlier. I'm not sure the reverse holds equally true.
It's still a personal decision.
:2cents: