I've been pretty vocal about the Confederate monuments, but I never cared about most of the other statues, names, etc. The issue is that Confederate stuff is exclusively a product of Jim Crow. It has little to do with the Civil War; they were all established decades after the war specifically to celebrate the Confederate myth as a symbol of segregation and repression. Regardless of what anyone thinks about them, or how artistically valuable they are, that's their real history.
This is different than most other commemorations. Those are largely put up because the subject had some actual significance, generally local significance. I'm not interested in going on a crusade to rid the city of mentions of every ostensible bad guy from history, and I doubt many other people are either. Andrew Jackson is a bit different as his legacy is so horrible. But even there, we don't have schools and statues dedicated to him because he was horrible, we have them because he's who the city was named after.