Discussion à propos de ce post

Avatar de User
Avatar de Christophe Henner

Hi, this is a quite clear, one of the clearest, articulation I've read of what's actually at stake, and I want to push / build on a couple of things.

II'm past 20 years in the Wikimedia movement, including some in leadership positions. I still believe in the idea of open both philosophically and politically. And I'm also a professional that have been working with AI and GPUs for ten years now. But, of course there is a but, I also believe that on present evidence, open doesn't have the teeth or the pocket to compete in the AI era. And of course that's not the core of your piece, but that is to me the greatest threat. Not the threat, the lack of real capacity to answer to it.

Wikipedia is the closest thing humanity has built to your "open individuation": a cognitive commons where the people who think with the tool also shape it, where feedback is open, stored and contestable, where governance is (very very) messy but real. It mostly works and it still is one of the most trustworthy information/knowledge repository of the internet age.

And yet: its annual budget is a rounding error on a single frontier training run.

Its compute footprint is a rounding error on a single data center.

Its governance cycles run in months while model releases run in weeks and half billion of dollars are raised every two weeks.

The very features that contributed to its success and make it legitimate (to most people) - open deliberation, volunteerism, consensus - are the features that makes it structurally outpaced by the current speed of things.

So when you write that "closed cognitive infrastructure is structurally incompatible with a free society," I agree. More than I can convey in a comment.

When you write that the institutions of open individuation are "largely unsolved," I agree more emphatically than you could have intended.

The bazar comes with a lot of benefits, with a lot strengths and diversity. A lot of creativity, passion, and fun! But in this time, we need coordinated bazars, not a cathedral, that's now how we run.

To me the three bottlenecks are quite "easy" to lay down:

First, '''open without compute is a museum'''. The Wikimedia lesson is that a commons of content needs a commons of infrastructure underneath it, or it becomes raw material for someone else's product. Which is precisely what has happened to all of us in the commons. Models trained on Wikipedia do not return value to Wikipedia; they absorb it and privatize it, exactly as you describe. And they privatized knowledge, but also revenue and in the end volunteers renewal. Public compute isn't optional. It's the precondition but it takes money...

Second, '''open needs a revenue model that isn't donations'''. Wikimedia survives on the generosity of readers and a handful of foundations. That model does not scale to training and serving frontier models. If we're serious about open individuation, we need to be serious about public funding at the scale of public broadcasting or public universities. Mozilla has been a great example for the the last 20 years, and we may need to achieve that feat again if the open is to be a player.

Third, '''open needs a fast governance'''. The painful lesson from Wikipedia/Wikimedia is that deliberation at the speed of consensus gets lapped by iteration at the speed of capital. I don't know how to reconcile this. I wish we shouldn't have to, there is value in a slow pace. And open builds in small nodes. We're scattered. There are initiatives and good will all around.

When Anthropic, Google and OpenAI concentrate a good chunk of the ressources, we spread ourselves thinner.

What it looks like, I have no idea. But we need all like minded people together. Not researchers in x labs, 30 working groups on AI, some business people on the fringes, random volunteers experimenting. We need to really come together (I guess this comment is a bit me of trying to do that).

All of that together creates my current paradox and struggle, I believe we need to reinvent ourselves, in the open, in a way that is much deeper than ever before. The last generation, which I'm part of, build the open in a frugal, volunteer driven, consensual way. I am not sure we can afford that anymore.

And if for anything, for one reason, to this day there is still not even one open LLM frontier model (aside from Olmo). And without that we're not in the game. And we could take the game to SLMs maybe, but we should be honest, most of the war will be on the LLMs battlefield.

And there are other ways, options, ideas, but all of them will require more ressources than what we're mustering.

Sorry, this was a lengthy comment, and thanks for writing on the topic, I really like your articles :)

Avatar de Patrick Kervern

Brilliant piece. Open individuation has legs. "Seize the means of thinking !". Merci Anastasia.

3 commentaires supplémentaires...

Aucun post

Tout à fait prêt. Qu'avez-vous pour moi ?