Yes, no need in disturbing 99.875% of your road just for a few holes. You have a road to maintain. Extra gravel is good to have. Just get a bag of Portland cement, fill the hole with gravel, sprinkle a couple handfuls of Portland on it, maybe water, and leave the rest of your good drive alone.