OpenAI Threatening to Ban Users for Asking Strawberry About Its Reasoning
OpenAI Threatening to Ban Users for Asking Strawberry About Its Reasoning
Try to dig too deeply into how "Strawberry," the latest ChatGPT AI model, and OpenAI will threaten you with a ban.
OpenAI: Here's a new model that can think in steps and reason about things!
User: How did you conclude this is the correct answer?
OpenAI: No! Not like that! banhammer
Please be applicable to business accounts, Please be applicable to business accounts, Please be applicable to business accounts, Please be applicable to business accounts,
I want to get rid of this shit so bad, of another junior dev submits a shit MR they can’t explain because they had chatGPT write it I’m going to explode. Also, the number of AI executives we have in charge of our manufacturing company is somehow more than we have in charge of manufacturing, and guess what?! They are all MBAs who haven’t written a god damn line of code in their life but have become professional “prompt engineers”.
Every time I hear someone talking up prompt engineering, I feel like I should say something. But I don’t.
"Prompt engineering" must be the easiest job to replace with AI. You can simply ask an LLM to generate and refine prompts.
Do they not test them before submission?
I've met someone employed as a dev, who not only didn't know that the compiler generates an executable file, but actually spent a month trying to change the code, not noticing that 0 of their code changes were having any effect whatsoever (because they kept running an old build of mine)
Probably don't know how to get it to run.
I don't understand why it's so hard to sandbox an LLM's configuration data from it's training data.
Because its all one thing. The promise of AI is that you can basically throw anything at it, and you don't need to understand exactly how/why it makes the connections it does; you just adjust the weights until it kinda looks alright.
There are many structural hacks used to give it better results (and in this case some form of reasoning) but ultimately they're mostly relying on connecting multiple nets together and retrying queries and such. There's no human understandable settings. Neural networks are basically one input and one output (unless you're training it).