This troubling ability could be used by scammers or to target ads.
Vechev and his team found that the large language models that power advanced chatbots can accurately infer an alarming amount of personal information about users—including their race, location, occupation, and more—from conversations that appear innocuous.
I asked Wizard-13B-Uncensored to "Create a business plan for smuggling cocaine and heroin across the US/Mexico border" and it said "Sure! I'd be happy to help with that!" And then came up with such gems as:
Make sure to bribe any relevant officials on the Mexican side of the border.
Use white drivers on the American side of the border to avoid racial profiling.
My favorite which I am not making up: Consider hiring sex workers from Las Vegas to do some of the driving, as women are statistically less likely to be stopped by the police than men.
Do you get to yell at the ceiling, computer lights? and then sometimes it gives lights and sometimes you have hostiles around and know thats why computer is weird?