I have the exact same experience. Most of the people with an anglo saxon background are voting yes, most of the people from other backgrounds are voting no. Some of the reasons given is because they think it will privilege one group over another, they don't like the idea of one group being identified for "special treatment", etc.