... Alignment under the drill press quill is paramount!
a center finder is the only way to go. they are a little high but if your gonna be drilling pipe they will make you life a lot easier and it will be right https://pipefitter.com/store/centering-head-standard.html