We have paper wasps in my house. A spray bottle full of water with about 5% dish detergent does the trick too. Can confirm it works on yellowjackets as well.
At the risk of minor spoilers: I had a full party at that point and still needed help. I refuse to kill innocent animals so I let the spiders out and let them do a good chunk of the killing for me indoors.