WTF?! I don't see the issue here. People keep dogs, cats and other animals as pets, what's wrong with a goat that is in a fenced in yard?
Just another case of local government trying to become a nanny state! :-)