A few years back, some log cabin Republicans walked beside a sports car in the Austin Pride Parade. You could tell exactly where they were because the crowd fell silent as they passed. It was cool hearing the silence move down the street, nobody booed we just ignored them.
There have been members of the community aligned with the far right for a long time. There was even a hugh ranking gay nazi that worked for Hitler before he outlived his usefulness and IIRC ended up in a concentration camp.
Yes, a lot of people think that they will be considered "one of the good ones". They can't accept that it doesn't matter how much they match the rest of the politics. Being a person of color, gay, etc is all anyone needs to hate you.
P.S. Adding that after the Stonewall riots and getting the NYPD to leave gays and lesbians alone, those upper middle class white gays and lesbians took theirs and ran off. The whole movement fell apart and bi, trans, and others are still suffering.