I really want to use AI like llama, ChatGTP, midjourney etc. for something productive. But over the last year the only thing I found use for it was to propose places to go as a family on our Hokaido Japan journey. There were great proposals for places to go.
But perhaps you guys have some great use cases for AI in your life?
I use it quite a bit. I don’t trust big companies who commercialize AI so I run my AIs locally on my old retired gaming desktop that I’ve turned into a homelab/media server.
I use Kobold.AI to self host an LLM like ChatGPT (Dolphin-Mistral7b if you are curious). I mainly use it for low effort knowledge searches for stuff that is easier typed out long and descriptive (since google struggles with this). Since it’s AI I have to be careful about what I search since I’ve seen it make stuff up but for the majority of what I use it for (Programming syntax, Linux troubleshooting, general questions) it’s pretty good.
I also have Stable Diffusion running as well using the ICBINP model (which is pretty decent for photorealistic images). I use this AI to generate social media display pictures and porn :) it’s fun because it’s a surprise at what you’re going to get but sometimes it generates absolute horrors. Anatomical horrors. Those are genuinely horrific. Other times it’s really good.
How do you set up stable diffusion to run locally? I have been trying out llama.cpp for text and was looking for a similarly easy tool to try image generation.