2周前

Canadian (or just non American) AI/LLM Host?

It's not for anything important but I host a stupid discord bot trained on my friend group's server chat history. It's pretty much just a lobotomized ChatGPT but it's a lot of fun. I'm looking to move off of OpenAI's infrastructure though to something that doesn't give money to the USA but it seems like everything is American.

Basically, I'm just looking for somewhere that I can finetune and run custom models. Does anyone know of such a place?

4 评论

More involved but you can host models locally.
Edit: and also not send your data remotely if you really do benefit or have to use them.
- Yeah, I’m thinking I’ll actually just pick up a used 3060. I already have server hardware running Proxmox so it wouldn’t be the hardest to setup
  
  My laptop has a 1650 and I'm able to run a local StableDiffusion model. Some things are a bit too intense for it, for instance I'm restricted to 514×514 resolution, but it works well. A single image finishes in under a minute.
- This. Run it yourself.