I once saw 20 cows ambling through front yards in a subdivision grazing in flower beds and lawn grass. They broke out of a farmer’s adjoining pasture.
And the farmer is legally responsible for the damage, even if he was there first - his property is still not allowed to damage someone else’s without liability.
There’s a big difference between children/players hitting a ball onto someone’s lawn and hitting a ball through a window/denting a car/injuring a person.