OpenAI ↗ · 2026-07-08 21:00 · UTC+8
Separating signal from noise in coding evaluations
Company news OpenAI Source language: English
A new analysis from OpenAI reveals issues in SWE-Bench Pro, a popular coding benchmark, raising concerns about reliability and accuracy in evaluating AI models.
Excerpt
A new analysis from OpenAI reveals issues in SWE-Bench Pro, a popular coding benchmark, raising concerns about reliability and accuracy in evaluating AI models.
Short excerpt from the source — open the original for the full text.