Want to build the next SWE-bench?
Its co-author @OfirPress says to start with people. Find teammates you can bounce ideas off of, then work on really tough problems that seem absolutely impossible.
He shares how SWE-bench went from a lukewarm launch to one of AI coding's most influential benchmarks in the first episode of Evaluated, hosted by Gina Lee.
Here's a sneak peek:
The leading platform for crowdsourced benchmarks, competitions, and hackathons where the community shapes real-world progress in AI.