Community-voted rules are a nice idea, but you need to have at least veto power, as bad actors may propose and vote-brigade intentionally exploitable rules or rules that marginalize vulnerable communities.

Use your best judgment to protect your community against those who desire bringing hatred and abuse. Just be prepared to explain the reasoning behind your decisions, and be prepared for vote-brigading (however unlikely it may be) when you veto.