This is somewhat (I stress the somewhat) justified as our 'changes' to the environment have occurred rapidly while beavers have been building dams for thousands of years (allowing time for other species to adapt to those changes).
I take it that your point would be something along the lines of "harm" being relative? I think I could agree with that if that is your point.