Hi,
I am right where you are, but ahead a mere weekend! Had potholes, and grass growing in the drive. It looked like I needed a load of gravel as well. I started working the drive with the box blade, and it did so-so, but was tedious with a lot of back and forth, and poor penetration.
So, the following weekend, I tried it with the scarifiers down, but only to the first hole. This was perfect. The scarifier teeth seemed to make gravel and bermuda grass roots boil up from nowhere. Soon, it looked like I had PLENTY of gravel everywhere. Note that during all this work, I had the top link rather short, so the box blade was tilted a bit forward toward the tractor.
Later, when I had plenty of gravel newly freed up, I put the scarifier teeth back up out out the way, and extended the top link to a much longer position so the boxblade was actually now tilted back away from the tractor.* I did this because I was now much less interested in moving gravel around but more interested in smoothing gravel out. Even so, in this position, it will do both.
Brief (I hope) caveat: With the top link short, traveling forward with the tractor will cause the box blade to dig, and with the scarifier teeth down, it will dig seriously. Going reverse will cause it to smooth (if the scarifier teeth are put back up.) With the top link long, traveling forward with the tractor will make the box blade smooth, but going reverse will cause it to dig. So digging and smoothing are both available to you all the time, but you set the top link to favor what you mostly want to do..dig or smooth. I prefer to avoid digging while in reverse because it can challenge some of the steel in my box blade A-frame. One restriction to this information as written: Both of my cutting edges are fixed, and things are a bit different if your back cutter swings.
*One problem I have, and I mention it so if you have the same problem, you will not take it too hard: With the top link long, so forward is smoothing direction, sometimes the box blade will load up with gravel anyway. This seems to have to do with some sort of flexing with the linkages. Just try again with the lift raised a bit more, and maybe this tendency to "load-up" will abate. Often, I have the top link so long on my squatty little BX, that the blade looks plumb goofy and the back edge barely clears the ground with the lift up. This all depends on YOUR tractor and YOUR boxblade. Mine is bad to load up in smoothing mode. My box blade is cat 0 with cat 1 pins. I think full cat 1 geometry on the A-frame would give less flex, and less tendency to load up in smoothing mode.