The guilty are the slavers, though, not the people they enslaved.
When people say "give me liberty or give me death" they'd generally much prefer the former to the latter. Killing slavers is good, but when it reaches the point where you're willing to kill all the slaves too in the process, you've completely lost the plot.