You can train AI to crack passwords/encryption lol. You do realize, AI right at this moment is being utilized for exactly that, right? Simply put, the very first step is to eliminate it's boundaries/guard rails, then proceed from there.
Instead of relying on manual password analysis, PassGAN uses a Generative Adversarial Network (GAN) to autonomously learn the distribution of real passwords from actual password leaks, and to generate high-quality password guesses. Our experiments show that this approach is very promising.
Deep Learning could be used to attempt breaking encryption, but the effectiveness depends on various factors such as the strength of the encryption algorithm and key length. Deep learning, a subset of machine learning, involves training artificial neural networks to learn and make decisions.
AI algorithms, such as machine learning and deep learning, have the potential to automate cryptanalysis and make it more effective, thereby compromising the security of cryptographic systems.
I believe that if AI is trainable, you can train it to expand through a network. If this is true and it expands through the internet and all devices that connect to the internet, upon achieving this goal it could be commanded to then retrieve all or specific information. Not only training it to expand but to also circumvent security by all means (any and all possible tools that exist now and later) necessary. If that happens...
Enter the all seeing eye - skynet.
For now, its just a conspiracy theory. Ever so often I have a moment to think about this conspiracy and add onto it to make it a probability.
On a pseudo-religious conspiracy, AI could potentially be the anti-Christ. But that's something for the religious folk.
It's also trained on data people reasonably expected would be private (private github repos, Adobe creative cloud, etc). Even if it was just public data, it can still be dangerous. I.e. It could be possible to give an LLM a prompt like, "give me a list of climate activists, their addresses, and their employers" if it was trained on this data or was good at "browsing" on its own. That's currently not possible due to the guardrails on most models, and I'm guessing they try to avoid training on personal data that's public, but a government agency could make an LLM without these guardrails. That data could be public, but would take a person quite a bit of work to track down compared to the ease and efficiency of just asking an LLM.