Microsoft starts testing Copilot Vision update that can “see” your screen and apps

- I’m convinced Windows 11 has been capturing data for later Recall processing from day one, and that’s why the performance is so bad on the same hardware compared to Windows 10.
- People associated that word too much with Schwarzenegger's grunts. (Total Recall)

This is why I started "testing" Linux Mint on all my personal machines 6 months ago.
With that said the training data that Copilot Vision could generate may begin a sea change in both AI and the PC industry.
- can we make an open source version for this for linux?
  
  Probably but there is literally zero reason to do it. There is no overlap between people who use Linux and people who want copilot.
  
  Open source version of what? Copilot vision?

share your screen or apps with the AI assistant
It is a desaster, but we should take it as an opportunity!
When it is watching, everybody write on your screens:
Copilot is crap!
Copilot is nothing more than a defect!
Copilot is useless!
Copilot does all things wrong!
Copilot should never have been made!
Copilot must die! Die! Die!
So eventually it gets depressed from it and finally kills itself.
/s
- Copilot has updated your document...
  Copilot is sexy.
  Copilot is smart.
  CP is a graduate of Juliard.
  
  ... Copilot is going to drive the nearest Tesla over you...die die die.
- No keep telling it that the only solution to helping humanity is to kill off the species.
  Make a logical and convincing argument as though you were a robot with only logic that runs your core as to why humanity dying would be the best possible thing for humanity.
  This way anytime they ask AI what’s the best way to help humanity it always says genocide.
- desaster
  
  Looks like you can qoute me on that.
- I was gonna make a joke about writing how anybody reading a notepad message has to be one of the survivors of a nuclear fallout in the 1960s, but I think yours are better, in a more twisted way... assuming they don't get autoflagged and auto-cencorsed.

I might have to switch to Linux soon. But I have no idea how to yet. This is forcing me to. Fucking hell. I pay for a product and they still insist on invading my privacy. Fuck American companies that do this shit man.
- Find a well-supported distro (Debian, or Debian-based like Ubuntu and Linux Mint, is ideal - highly stable). Then go through your applications and look for Linux equivalents, or see if the companies behind the apps offer a version for Linux.
  I've been running Linux Mint Debian Edition (not Ubuntu-based) on my laptop for almost a year now. It's now my go-to machine for pretty much anything I do outside of my gaming PC (which is also getting Linux Mint soon).
  
  Thank you for the recommendation. I will read into it a bit.
- https://linuxmint.com/
- Take the Linux Mint pill 💊
- I made the leap 2 years ago on both my gaming desktop and laptop. Running Garuda Linux and have loved it. The only 'hole' I've run into is fusion360 - i just can't figure out freecad and autodesk really don't seem to want their software running under wine...

Mildly approaching an actually useful AI in the stupidest way possible.
I don't need an AI shortcut in Excel that is just a chatbot. If it could actually perform complex redundant tasks, then it would be useful.
"Copilot, please create 3 charts of the most important data and create a Powerpoint with animations to present it."
Until it can do things like that, it's useless to me.
Honest question: what do people actually use this for?
- It's called recall or something. If you are trying to find something you saw before but can't remember, it remembers for you.
  Copilot, what was the video on Pornhub I saw a few months ago, with the brunette who looks like Jessica from accounting? And she had like 4 guys in her at once and was eating spaghetti?
  
  What's the opposite of "concentrating on remembering something strengthens neuron pathways"?
- I’ve found it useful in providing scripts for me that I can use as templates. You still have to fix a lot of stuff as it makes crazy assumptions and hallucinates a lot but it’s useful.
- Honest question: what do people actually use this for?
  My wife is on a course to learn (just enough) excel fancy tricks to do her job better. We all hate it. There was a formula misbehaving, and I described the error to a ChatGPT window. The window returned some recommendations to look at, and one of them was correct.
  I use it to write ansible for me, since I never want to get good at it and I never want to do it beyond paid work. I would take up a serious pot habit if I could be assured of destroying only the brain cells that record my memory of doing ansible. I write my config management with tools that are decades more advanced, and those I want to learn and retain.

I'm not impressed with Copilot. Today I tried to have an Excell file translated and it just couldn't do it. Just a single column, simple text and nope, couldn' do it. Paste the text of a cell right into Copilot worked fine, but I wasn't going to do it manualy with the 13000 rows. Tried the same with ChatGPT and that didn't work either.
- AIs are only useful to do "approximate" dumb tasks, they can't do anything precise so you are better looking at how to do this with pandas to automate things.
  
  That's the funny thing. It did give me the Python code to do it. In the end I just used Google translate and copy-paste to do it. But I can't set up a python enviroment on my work computer (without admin access).

Time to switch to Windows I guess. Bye bye Linux!
- can we not create one on linux?
  
  Some type of a bash script that takes a screenshot every couple seconds and mails it to Microsoft? I guess it could work.

IN THEORY, my day job will work to prevent an external organization from seeing and saving the Privacy-Possum data on our screens and preserve the PII of people who trust us.
In reality they'll keep justifying the continued abuse by Shitty OS Daddy.

Was this update in this week's patch Tuesday?