I believe that's a little knee jerk. My brother, who is a real rough and tough redneck type of guy, is researching it to see what it really means. He wants to understand what implications could lay ahead when voting either way. To call someone racist for wanting critical analysis and clarity doesn't help. In fact, it drives division, in my opinion.
We need to have a vote on this because it is a constitutional change. There have been a few advisory bodies over the years, but then the opposition gets into power and they kill them off. Having it enshrined in the constitution means that will no longer be possible.
The details really aren't that important. How the body is compromised isn't going to be part of the constitution. And frankly, as a white person, it isn't really my place to tell indigenous people how they should put this advisory body together. They're not in parliament. They aren't voting on bills. They don't have veto rights. They just have a channel where they can speak on topics under discussion.
Before anyone starts to say even this is too much power, ask yourself how much power Rupert Murdoch should have. Because he and every other billionaire in the country has a pretty loud voice.
Not a lot is going to change from this. Why bother then? Listen to or read of the Uluru Statement From the Heart. It's only a page long. There is no hidden agenda. 300+ first nation tribes from around the nation got together to make it.
The official booklet provides a summary of the main points for both sides, each given 5 pages. That said, there has been a lot of criticism about how these points have been explained and published, so it's not a perfectly balanced explanation from either side, but it's a start. https://www.aec.gov.au/referendums/files/pamphlet/referendum-booklet.pdf
As you can see from comments, if you try to offer any considerations about the No side, someone from the Yes side will call you a racist.