The first GPT-4-class AI model anyone can download has arrived: Llama 405B
The first GPT-4-class AI model anyone can download has arrived: Llama 405B
arstechnica.com The first GPT-4-class AI model anyone can download has arrived: Llama 405B
"Open source AI is the path forward," says Mark Zuckerberg, misusing the term.
You're viewing a single thread.
61
comments
Did anyone get 70b to run locally?
If so what, what hardware specs?
Afaik you need about 40GB of vram for a 70b model.
Can't you offload some of it to RAM?
Same requirements, but much slower.
I guess time to buy some ram after spending decade at 16gb
You've viewed 61 comments.