Immediately don full protective gear - full face shield AND goggles, and gloves, long sleeved shirt and long pants and hat. Approach battery with NO jewelery and no possible source for sparks or ignition, no metal on your person, NO cigarettes, or other possible sources for ignition/explosion. Have a second person in the nearby area, but NOT in the work zone in case something goes wrong.
Have baking soda and a hose ready to be used if needed. Disconnect ground side, (negative) battery post connection at battery and place the cable so it cannot touch the battery or post.
Remove the positive battery post clamp too, and then carefully remove the battery and place it away from any source of ignition, like a water heater, car, etc. After letting the battery sit for a few hours use a VOM to check the battery for voltage present.
Now you need to go through your entire electrical system and find what is causing the overcharge condition. Your battery is NOT the cause. It will be either your new voltage regulator or your alternator, depending on what your tractor has as equipment. The alternator makes the output voltage and can definitely go above a batteries needed voltage of 14.25-14.50 volts MAXIMUM without any issues, BUT your voltage regulator is what is there to LIMIT the voltage to what is required and NO more.
Post back results, and keep the battery away from any people, especially inquisitive children. It's still a potential risk for explosion based on what you said it was receiving for charge voltages above 14.5 volts.
Best to store it outside away from any building, people, vehicles, etc. so if it explodes it will not harm property or persons.