Tolerance is just an extension of the social contract. Intolerant people are actively violating the social contract and, as such, are not eligible for the benefits such a contract provides. This has been settled law for millennia. Live and let live... or else.