Why we no longer evaluate SWE-bench Verified
OpenAI Blog·February 23, 2026 at 11:00 AM·
Trusted Source
SWE-bench Verified is increasingly contaminated and mismeasures frontier coding progress. Our analysis shows flawed tests and training leakage. We recommend SWE-bench Pro.