There're some nice UI features that I'm not sure could be achieved with extensions and some of the privacy features include having removed some statistics tracking that can't be disabled in stock Firefox.
Firefox also comes with some preinstalled extensions like Pocket, and that screenshot tool. With WaterFox you can choose not to install those.