"The question is, can the guy with attitude use the OP's driveway legally with no recorded deaded access, easement, etc...?"
Possibly. Here is a basemap example from somewhere in Achulata County, Colorado. You see where there Is a Road Right of Way, and between the properties, but you also see the road is Not located in that ROW, if you are the guy with the road cutting across your property, you are likely just SOL. The county is not going to relocate the road back to their ROW, if they Pave this road, they will do a taking based on maintenance. They most likely will not need to pay the owner either.
Land law is complicated; things line easements more so.
A Common issue in FLa, state, county, or business has a drainage easement going to a water body (could be a creek, lake, river). So, let's say it says, and is recorded, 30 ft drainage and maintenance easement extending north from the northern ROW line to discharge point 150 ft north. Ok, as happens the lake drops a couple hundred feet. That easement will still extend to the water body, regardless of if that is 400 ft away now.
Properties are frequently broken up, combined, broken again, adjusted, ect; and often old easements kinda get lost. So, you combine prop A, B, C, and D, and there is an easement through property C, I have seen were that gets lost, until someone digs through paperwork from 1939. Doesn't matter that its not shown on the deed, if the easement holder still had evidence, the 7th owner of ABCD still has an easement across it, and the original easement holder isn't going to pay anything for that. That does Not mean that the 7th owner of ABCD can't go after his title insurance, If he can show lose.
For a 20 ft (or 30/40 ft) easement on a 200 acre property, that hugs the property line, and already has multiple other easements, I dont think it's worth the fight.
But, to the original OP, and including some of Pinions other posts, you don't need to (and should not) feel obligated to maintain that "tee" off your drive for this guy, or any of the others.
View attachment 1903177