As with any electrical problem, start checking the voltages all along the current path, starting with the source [the battery] and at every connection point along the path, of course, while trying to start, to see where you are getting the voltage loss. At the point you see a substantial voltage loss under load, that's your "bottleneck" that needs to be fixed... and yes, there may be multiple spots. And don't forget the ground path too, first putting the meter's negative at the battery, and then if that's OK, move the negative probe to a good ground on the starter.
And yes, the quickest check is just to short the solenoid battery terminal to the starter positive feed with a screwdriver, which bypasses the solenoid contacts and will at least let you know that the battery and primary cable are OK.