Consider this hypothetical scenario: if you were given $100,000 to build a PC/server to run open-source LLMs like LLaMA 3 for single-user purposes, what would you build?
Consider this hypothetical scenario: if you were given $100,000 to build a PC/server to run open-source LLMs like LLaMA 3 for single-user purposes, what would you build?
Why in the world would you need such a large budget? A mac studio can run the 70b variant just fine at $12k
So the answer would be “an alibi for the other $88k”