I agree with you. My husband used to trap two or three a night in our Tempe, AZ home and then we'd bring them to the pound. One day a woman knocked on our door from the local cat rescue group complaining that we're responsible for killing dozens of cats. We kindly explained that as cat owners (I have 2), it's not that we have anything against cats it's just that we didn't like our yard to be the neighborhood litter box.
We never caught one with a collar and the pound scans the cats for imbedded micro chips so that if there is an owner, they are notified. Apparently the cat rescue group would 'rescue' cats, get the micro chip put in, and then set them loose again in random neighborhoods. We had it out with the woman, and then trapped a cat later that night! :) The best solution was moving from that neighborhood though!