This is a great question. You definitely aren't training this to use it, you're training it to understand how things work. It's an educational project, if you're interested in experimenting with things like distributed training techniques in JAX, or preference optimisation, this gives you a minimal and hackable library to build on.
It's also a great base for experimentation. If you have an idea for an architecture improvement you can try it for $36 on the 20 layer nanocode setting, then for another $200 see how it holds up on the "full scale" nanocode
Kaparthy's notes on improving nanochat [1] are one of my favorite blog-like things to read. Really neat to see which features have how much influence, and how the scaling laws evolve as you improve the architecture
There's also modded-nanogpt which turns the same kind of experimentation into a training speedrun (and maybe loses some rigor on the way) [2]
I was also very confused, but after some reading I figured it out.
> In an interview with NBC News from space, NASA astronaut Christina Koch described seeing the moon out the window of the Orion capsule and realizing that it looked different from what she was accustomed to on Earth.
> “The darker parts just aren’t quite in the right place,” she said. “And something about you senses that is not the moon that I’m used to seeing.”
They are not on the other side of the moon seeing the full dark side, but from their position they're seeing the moon at a slight angle, meaning that SOME of what they now see is "the dark side", or the part we can never see from earth since the same side always faces us
This. We all thought Trump was a crazy accident but the fact that he almost beat Biden, and then did beat Harris, means we just can't trust Americans to put sensible people in charge. Assuming a democrat takes the office next, they will inherit an economy in tatters, a failing infrastructure and a broken strategic alliance. They'll have four years to try to fix all of that while the republicans blame them for everything they've inherited, and four years from that the American people will have largely forgotten how Trump and his minions trailed dog shit all through the house and they'll vote for the next right wing dick that's been groomed for the job - probably Pete Hegseth, or Don Jr, or Mark Wayne Mullin
Neither Biden nor Harris were sensible candidates. Democrats could have easily beat Trump by running a more appealing/less polarizing candidate. Didn't even have to be both. Obama was polarizing but he was appealing and he won comfortably.
As a non-American I have always wondered about the criteria used by Americans to vote for their presidents.
Clinton and Obama had various defects, but at least both of them looked like presidents and talked like presidents.
On the other hand, both George Bush Junior and Trump (of course especially the latter), looked like clowns and talked like clowns.
I have never understood their appeal to the masses. I understand the discontent of those who have voted against the Democrat "elites", but the fact that anyone could look at Trump and believe that he is the right man for the job seems unbelievable, regardless of how inept were his opponents.
We always talk about what these powerful people "have done", as if it's all over. Surely Epstein's death did not bring about the end of billionaire sex trafficking? Someone stepped in. These guys are still raping people on private planes and private islands
But why are we focusing on the raping, and not on what the American government is doing that has no clear rational motive without “Israel has captured the government” and a very clear rational motive with “Israel has captured the government”?
If the American government continues to perform actions that are blatantly against the interests of America and Americans, the impact of that on Americans is going to be (and may be already) massively massively worse than the person to person level crimes we are focusing on.
Does it just feel so bad thinking about it that a lot of people have a hard time even going there mentally? I really don’t get it.
I can't shake the feeling that Trump's continual needling of Europe is intended the destroy NATO. And this is a desire of Putin's.
I know it's conspiratorial, and I hate that, but it's one of the only things that makes any of the actions of the US in the last year make any semblance of sense.
I don't like to think that, but it remains, for me, a valid scenario.
Well, I have no idea. I'm just guessing it's not the reason I like the war.
I generally only attempt to scrutinize government action, and not government reason for action. Random citizens are at such an information disadvantage that I think it would be impossible to have an informed opinion as an outsider on the reasoning.
It could be as simple as "Iran kept trying to assassinate me so I'm going to assassinate them". Maybe he was pressured by Israel, I really have no idea.
> I generally only attempt to scrutinize government action, and not government reason for action
This might be the wildest opinion I've read.
You're onboard with the US bombing another country ("I like the war"), but you don't know, or care WHY. You just think it was a good idea.
"Random citizens are at such an information disadvantage that I think it would be impossible to have an informed opinion as an outsider on the reasoning."
I'm trying to give you the benefit of the doubt here, but if you re-read your own words, you've just said a random citizen like yourself can't possibly know enough to have an informed opinion, yet you gave us your opinion, which is that you think they should have bombed Iran.
You need to reread my words. I never said I can't possibly know enough to have an informed opinion generally. Nor did I say it's impossible to have an informed opinion in what I gave my opinion on.
> Random citizens are at such an information disadvantage that I think it would be impossible to have an informed opinion as an outsider on the reasoning.
Denazify… oops, wrong country, sorry. "Changing the regime". But it cannot possibly be true because regime change, just like foreign wars are bad according to Trump. So, in reality, who knows?
My guess is that some nutcases at the pentagon got an adrenaline rush during the little adventure in Venezuela and looked for another country to mess with. It’s obvious that no real thought was put into what exactly is the point of all of this or how to actually get to that point. I mean, they were surprised that Turkey was upset and that Iran closed the Gulf. Or that none of the allies Trump has been shitting on for decades showed up. This does not point to any serious thought process.
The EU leadership I'm most proud of at this moment is our collective unwillingness to back up the US over the Iran war. I just wish we'd stood up to them sooner.
Several economics Nobels and EU leaders have voiced concern about the impact stagnation will have. It's not a made up issue, there's a ton of discourse around it.
Also, I'm an American democrat raised in Spain and I have no idea what Fox would have to say.
I absolutely love this, it's beautiful. Kudos for the truly original ideas here in the UI. I love to see radial design patterns - everything is boring grids and rows and columns
Why would people want to spend $200 to train a coding model when there are free coding models?
reply