Voltage from your supplier will always vary from 110 to 125v. If you want to keep that from happening you’ll need a line conditioner.
I’d just buy a new UPS. It’s just a battery that goes bad after time.
Battery is usually pretty easy to replace, and much cheaper than a new UPS.