Be sure that your base under the millings is solid. There is no strength in asphalt, so it will move on you quite a bit unless there is a very solid base under it, and you have good drainage. Fabric will help a questionable area with road base rock, but it wont do anything for ashphalt.
Once you have a solid base, the only reason for ashpalt is to make it smoother and nicer looking then gravel.
The road base rock needs to be at least four inches thick. More if you have poor soil or frost heave. If you box blade it, then it will get thiner and fall apart on you, giving you pot holes.
Road base is rock of different sizes with jagged edges from several inches across mixed in with everything down to fines. Once spread and compacted, it locks together to form a solid, water tight surface.
Eddie