Researchers release SWE-chat dataset of AI coding interactions · KRO

From: Researchers release SWE-chat dataset of AI coding interactions

John Yang@jyangballin·15dQuote tweet

WildChat, OpenAssistant type datasets were very useful for understanding the effect of chat bots at scale. Now that SWE-agent's are the norm, SWE-chat aims to do the same for AI coding. Lots of fun findings, great effort led by @joabaum!

Joachim Baumann @ ICLR'26@joabaum·15dView on

We present SWE-chat: the first large-scale dataset of coding agent interactions from real users in the wild. In 40% of real coding sessions, the agent writes ~all the code. Users push back 39% of the time – agents almost never stop to check. Data, paper, & findings in the 🧵👇

Overview of SWE-chat. Left: a data collection pipeline diagram. Open-source developers install the Entire.io CLI tool, which logs their coding agent sessions and pushes the logs to a dedicated branch on their public GitHub repository. We discover and aggregate these logs into the SWE-chat dataset, with line-level attribution of which lines of code were written by the human versus the agent. Right: a growth chart showing cumulative logged events over time, rising steeply through early 2026. As of April 2026, the dataset contains 2.7 million logged events from over 200 repositories, including 63,000+ user prompts and 355,000+ agent tool calls across nearly 6,000 sessions.

View on