Elon Musk testifies xAI partly distilled OpenAI models
Elon Musk testified in the OpenAI lawsuit that xAI partly distilled OpenAI models to train its AI systems. Responding to OpenAI counsel, Musk confirmed xAI used distillation techniques on OpenAI technology and incorporates it in development. He noted AI companies generally distill from one another. The admission emerged during ongoing litigation between Musk and OpenAI, corroborated by journalists including New York Times' Mike Isaac.
AI 1000 · 13 actions
- QUOTEC🤗#111@CLEMENTDELANGUE@MIKEISAACWhat people call "distillation" is a super common practice (you use other models to benchmark your model, to evaluate your inputs or to add a little bit to your datasets) that in my opinion should be covered by fair use (just like using public data is), especially when the resulting models are open-source as it benefits all and helps break out monopolies that are strongly forming in AI!
- QUOTEC🤗#111@CLEMENTDELANGUE@MTSLIVEWhat people call "distillation" is a super common practice (you use other models to benchmark your model, to evaluate your inputs or to add a little bit to your datasets) that in my opinion should be covered by fair use (just like using public data is), especially when the resulting models are open-source as it benefits all and helps break out monopolies that are strongly forming in AI
- QUOTEC🤗#111@CLEMENTDELANGUE@DZHANG50I think the expression is “pulling the ladder”! All labs trained their models by distilling (at the very least distilling the web) which allowed them to become the fastest growing businesses in the history of humanity and now that they have armies of lawyers and lobbyists, they are trying to prevent others from doing the same thing.
- REPOSTC🤗#111@CLEMENTDELANGUE@DZHANG50does anyone else remember how Jacob Devlin went to the media about how Google was supposedly distilling from ShareGPT (it was not) and the resulting blowback? How times have changed 😅 https://futurism.com/the-byte/google-denies-bard-openai https://twitter.com/MTSlive/status/2049886679876632724
- REPOSTC🤗#111@CLEMENTDELANGUE@WONGMJANELast week: White House condemns Chinese AI labs for alleged distillation attack This week: Elon admits under oath that xAI distilled OpenAI models to train its models 🫣 https://x.com/wongmjane/status/2049963585112351089/photo/1 https://twitter.com/mikeisaac/status/2049883094535356454