I have some spare pea gravel (3/8"- round) sitting around, would that be a good base for either the concrete dust or paver floor?
If it is round pea gravel intended for drainage (no fines), it is suitable for use with pavers, but not with the concrete, where you want the fines (rock dust).
If it has fines in it, and you will know because the rock will be angular from being crushed and it will be dusty when you disturb it, then it is more suitable for the concrete dust tactic.
If you go ther "concrete" route, I would actually use Portland cement. A lot of people use the words "concrete" and "cement" interchangeably and they are not. Concrete is a mixture of sand, gravel and Portland cement. Usually, the gravel is up to 3/4" in the pre-mixed sacks. Portland cement is more expensive than concrete, and is the active ingredient -- the binder which holds everything together. A sack of cement is a heavy, fine powder.
Since you would be applying this over a base of compacted and relatively smooth gravel + fines, you want the cement. The intention is for the cement powder to sift down and bind the surface together.
Fifteen years ago, I did a similar thing, where I laid flagstones over compacted clay and then swept dry mortar (a mixture of sand & cement) into the cracks between them. A fine spray from a garden hose and the mortar set up. Five years ago, the mortar started to come out of the cracks, and today about 60 to 80% of it is gone. One of the tasks for this summer is to replace the mortar.