I have a drill press, milling machine, engine lathe, and a bunch of corded and cordless drills all within my "metal shop" space. I have another drill press and more hand drills in my wood shop space. To me, having a dedicated "in use" organizer at each tool makes less sense than one big organizer in each shop space.
Also, for any given size, I may have several each of jobber length, screw machine, brad point, forstner, and spade. Possibly in 118 and 135 point, and sometimes bullet point. Sometimes in HSS and carbide. In full shank, S&D, and morse taper shank...and square taper brace-and-bit. Sizes can be by 64ths, letter and number. I think I bought a box of metrics recently, if I can remember where I put it.
At the moment my current organizer is a shelf with a couple of half full indexes, a bin full of taper shanks and large sizes, and a pile of loose bits. Plus a pile "in use" next to whatever work surface I am using, which may eventually get put back. So this setup would be a big step up for me.
As for dull bits...if you are an organized person, why would you put them back in the organizer, and not, say in a "to be sharpened" bin next to the sharpener? Granted, my dull bits usually end up in the pile with the rest...I tend to check the edge on my thumb. The broken ones end up next to the sharpener...