Why do Germans think that having committed the Holocaust gives them special privileges to speak about Jews?

I think there'll be a split. The, eh, vanilla modern German view would be strongly in favor of it (EDIT: the uprising). But the fringe where the opposite opinion is acceptable starts not that far from it.