Why do you need a LLM running locally so much that's the inflated RAM prices are an attack on your wallet? One can always opt not to play this losing game.
I remember when the crypto miners rented a plane to deliver their precious GPUs.
Some models are useful; using whisper.cpp comes to mind to create subtitles for, for example, family videos or a lecture you attended without sending your data to an untrusted or unreliable company.
I remember when the crypto miners rented a plane to deliver their precious GPUs.