Would it really look that bad?

It was probably the shade of blue that didn't suit your coloration. If you really did want blue hair, there is likely a shade that would harmonize with your features better.