That’s tough (maybe impossible) to do unless the utilities are in your name. Putting the utilities in your name carries other risk.
If it is a private home only used for short term rentals such as an AirBNB the utilities likely would remain in the owner’s name. For longer rentals it does make more sense to have the tenant responsible for their own utility bills.
PS. It would be verboten if done to get the tenant (lazy bums) out. However if it is right there in the agreement I think it would pass muster. Provided the reason is to not have them on for a vacant property.