I feel like there's a lot of cherry picking here too, because if we take the MCU, it also does some race swapping that nobody has a problem with.
Nick Fury is one, but Samuel L Jackson is so cool in that role, it doesn't matter.
Heimdal is another one. Norse mythology, probably not a lot of black there, but Idris Elba is also so damn cool in the role that it does not really matter, and I've never heard anyone complain about these people.
I think in general it's more about if the people in the roles do a good job or not. Tilda Swinton did a great job. Johnny Depp... Maybe not so much, but I also do remember people were mad about that one.