Eddie,
Why don't you have top soil? I've heard that about part of Texas before.
Stuck
A long time ago I thought everyone had top soil too, and that you had to remove it before building. But then I saw buildings, parking lots and roads being built on the existing soil and started to wonder about that. Eventually I learned that there was no top soil there, and that it's actually rare to have top soil in a lot of places. Where I'm from in CA, we have very rich, loamy soil that never stops decomposing, but if you go into the Hills, or to the other side of the Hills, into the Valley, it's all clay and hard pan until you get to the Delta regions, where all the crops are.
Here in my part of Texas, we have red clay. There are dozens and dozens of types of clay, and each has a load rating, along with a movement rating. Red clay is the best. It holds weight, compacts easily and barely moves. Plants love it because it forms a crust at the surface that is super hard, but just a few inches down, retains moisture all summer long. There is no loam, or anything that will decompose over the years. It just doesn't happen here. In my travels, I've found this to be true almost everywhere except the places where it's obvious just by walking and feeling the soil move under your feet.
Removing the dirt to create a trench just provides a place for water to go to and not leave. Basically you are building a shallow pond. Add rock to the pond and you will have less area for water, but water will still find a way into there. It is much better to build up the road base so the water goes "away" from the road. Dirt, or red clay, is the cheapest, most available materiel to do this, so that's what we use. Either haul it in, or use what is dug from the ditches along the side of the road to build up the road bed. Then compact it and spread your road base rock over it.
Part of my land was a World War Army Base called Camp Fanin. The dirt roads are still in good shape where the jungle has not taken them over. Ditches and crowned red clay is still there 70 years later and I drive on them all the time.