I suppose what she suggests is what some OSS projects are already doing elsewhere. (And a good take on that cursed post-modernism, which is apparently hot again.)
So, as I share his thoughts, I've been wondering: why haven't we seen any real innovations in this space?
Mastodon wasn't really it and neither was Substack, although maybe it got slightly closer. TikTok and Telegram, maybe, for different reasons, but they'll face the same destiny.
I'd suppose the much despised "mainstream media" might be a winner here eventually. But beyond that, I am thinking about something like the following:
> If you fail to prove them wrong and can produce the same results as them, they have done Good Science.
Not really in my humble opinion. Sure, the Popperian vibe is kind of fundamental, but the whole truncation into binary-valued true/false categories seldom makes sense with many (or even most?) problems for which probabilities, effect sizes, and related things matter more.
And if you fail to replicate a study, they may have still done Good Science. With replications, it should not be about Bad Science and Good Science but about the cumulation of evidence (or a lack thereof). That's what meta-analyses are about.
When we talk about Bad Science, it is about the industrial-scale fraud the article is talking about. No one should waste time replicating, citing, or reading that.
Debian has always been Debian and thus there are these purist opinions, but perhaps my take too would be something along the "one-strike-and-you-are-out" kind of a policy (i.e., you submit slop without being able to explain your submission in any way) already followed in some projects:
Yeah this is what I was getting at with “reputation” - I think the world where anyone can submit a patch and get human eyes on it is a thing of the past.
IIRC Mitchell Hashimoto recently proposed some system of attestations for OSS contributors. It’s non-obvious how you’d scale this.
IoT.
reply