On my tractor the exhaust is tilted back at about a 60 degree angle from the horizontal. Of course, when I bought the tractor it was vertical...
I'm guessing the horizontal design requires more complicated piping and might be more prone to rusting out. On the other hand, the horizontal design probably keeps the exhaust out of your face better, and isn't vulnerable to those low-hanging branches on the apple tree.