Some local LLMs tested on an average gaming PC
Some local LLMs tested on an average gaming PC
github.com
Local LLM tests · donatas-xyz AI · Discussion #1
17 comments
-
Average gaming PC.
128GB ram and a 4070 12GB. Doesn't sound average.
-
No kidding. Steam survey definitely does not agree with this definition of average lmao
-
I was gonna say, 4x the amount of RAM I have, made me feel inadequate. like, "am I really that poor now? is my 2080 now considered potato gaming?"
it's simply been so long since I've gone "ok I need to upgrade" that I'm starting to get suspicious
-
is my 2080 now considered potato gaming?"
I'm going to keep using this 1070 until it fails it I get bored of Skyrim.
-
128GB won't make any difference in gaming when compared to, say, 32GB, so it's just to fit larger LLMs into memory. However, 0.5t/s is hardly usable for every day tasks, so 32GB will still be more realistic combination with the RTX4070.
-
-
I thought I had a lot of RAM with 64
-
Well, you do.
-
64 gigs of ram costs less than $200 these days
-
-
I didn't see tokens/s anywhere?
-
Performance/vision based tests have tokens/s at the end of tables.
-
17 comments