On the other hand, the historical significance of these figures and their statues or monuments is made irrelevant by the context in which they were erected.
For instance, if a statue exists because of the wealth of an individual (i.e. Cecil Rhodes) or because of their contribution to the slave trade (i.e. Edward Colston) it does not matter how they factor into a modern narrative.
As such, caution is not always necessary, and neither is context.