OpenAI's Michael Chang releases Flipbook AI pixel-streaming prototype
OpenAI Research Scientist Michael Chang released Flipbook, a prototype that streams every AI-generated pixel directly to screens, bypassing HTML, layout engines, and code. Developed with Eddie Jiao and Drew O'Carr, it delivers real-time interactive content, demonstrated on a BOOX color e-ink tablet.
First post
Imagine every pixel on your screen, streamed live directly from a model. No HTML, no layout engine, no code. Just exactly what you want to see. @eddiejiao_obj, @drewocarr and I built a prototype to see how this could actually work, and set out to make it real. We're calling it Flipbook. (1/5)
Why it matters
Michael Chang (OpenAI Sora researcher) led low-latency and long-memory features for Google Project Astra at IO 2024.
Flipbook renders all onscreen text as pixels from its AI image model instead of separate text overlays.
Any click on a Flipbook image generates a new pixel image that explores the selected spot in greater depth.
Flipbook powers its live video stream with a custom optimized video generation model combined with the image system.
4 more posts
MI Michael Chang@mmmbchang·Quote tweetInternet as a video game
ZAZain Shah@zan2434·