Hacker Newsnew | past | comments | ask | show | jobs | submit | enigma101's commentslogin

unpopular opinion -> AI slop killed open-source

first the junior then the senior and finally the ceo...

Really can't stand the image slop suffocating the internet.

they will likely die first when society collapses

here we go again

The language hurts the eyes


How so ?


Well done. I enjoyed this a lot!


what's the hardware needed to run the trillion parameter model?


It's an MoE model, so it might not be that bad. The deployment guide at https://huggingface.co/moonshotai/Kimi-K2-Thinking/blob/main... suggests that the full, unquantized model can be run at ~46 tps on a dual-CPU machine with 8× NVIDIA L20 boards.

Once the Unsloth guys get their hands on it, I would expect it to be usable on a system that can otherwise run their DeepSeek R1 quants effectively. You could keep an eye on https://old.reddit.com/r/LocalLlama for user reports.


Are such machines available in the A class clouds such as Azure/AWS/Google?


To start with, an Epyc server or Mac Studio with 512GB RAM.


I looked up the price of the Mac Studio: $9500. That's actually a lot less than I was expecting...

I'm guessing an Epyc machine is even less.


How does the mac studio load the trillion parameter model?


By using ~3 bit quantized model with llama.cpp, Unsloth makes good quants:

https://docs.unsloth.ai/models/tutorials-how-to-fine-tune-an...

Note that llama.cpp doesn't try to be production-grade engine, more focused on local usage.


nothing to see here folks let's move on shall we


>"We know that they are lying,

>they know that they are lying,

>they even know that we know they are lying,

>we also know that they know we know they are lying too,

>they of course know that we certainly know they know we know they are lying too as well,

>BUT THEY ARE STILL LYING.

>The lie has become not just moral category, but the pillar industry of this country [Russia]."

—Aleksandr Solzhenitsyn on vranyo [0] emphasis/formatting mine

[0] https://www.amazon.com/Gulag-Archipelago-1918-1956-Investiga...


That was such a bad book. Seeing how much of it is incorrect, made up, exaggerated etc. I never would have had much interest in the Soviet Union until I read a few trash books including that one that are hyped by westerners.

Though that quote is pretty good. Works well for liberal democracies in modern times


Which book is, in your opinion, a more accurate portrayal?

I love differing perspectives, am retired, and will read it.


i swear the biggest gangsters on the planet are deutsche bahn


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: