You can go to any country on the planet and see statues of things that have a very shady history. Getting rid of them due to some politically correct “offense of the moment” would result in erasing much of it.
Bad idea.
I think the question now is "Do we want it here?" Taking out all the Confederate monument would amount to a denial of a part of Southern (and American) history, but people in each location or institution are going to have to decide for themselves whether they want it in their yard. That means there will be pressure on the cities, towns, and institutions that really want to keep the statues after other places have gotten rid of them, but if a college really wants to remove a statue from public view, can you really stop them?