Skip to content
ES

Less noise. More signal.

Context · Frontier AI · sweep Tuesday, November 17, 2026

Code agent benchmarks for autonomous software engineering

Evaluation of code agents shifts from saved functional tests to long-horizon tasks, evolving repositories and compliance with repository policies. The bottleneck is no longer the ability to generate correct patches but reproducible verification and governance of autonomous code, which conditions enterprise adoption of software agents.

Title, thesis and gravity assessment written by an AI model, without prior human review.

Gravity30/100 · Background
Why this gravity
Los 11 artículos son preprints de arXiv que proponen nuevos benchmarks (SWE-Bench Pro V2, ExpertCrowd-SWE, SWE-Shift, SWE-CC) para agentes de código; no hay release de modelo, adopción industrial declarada ni métrica de un actor Tier 1 que reordene el sector. La proliferación de benchmarks señala un problema metodológico de verificación, no una discontinuidad material observable hoy.
— Assessment by the Semantic Gravity Engine
Coverage
1 feed · 1 independent publisher group (a single publisher group)
Cross verticals
Frontier AI, Tech Industry, Startups
Gravity vs. the previous edition
−5 (35 → 30)

coverage, not accuracy

First detected Mon, Nov 16 · 2 days trackedGravity evolution
Lead source
SWE-Bench Pro V2: A Cleaner, Harder-to-Game Coding Benchmark · arXiv CS.AI / Soham Dan, Jeff Da, Sanyam Bhutani, Miguel Romero Calvo, Ivan Guevara, Fernando Carabedo, Jose Bernal, Julio Reyna, Luis Leandro Monsalve Mendez, Ying Liu, Daniel Yue Zhang
Actors: arXiv · SWE-Bench Pro · ExpertCrowd-SWE · SWE-Shift · SWE-CC · GitHub
Timeline · Madrid time
  1. 06:00
  2. 06:00
  3. 06:00
  4. 06:00
  5. 06:00
  6. 05:00
  7. 05:00
  8. 06:00
  9. 06:00
  10. 06:00
  11. 06:00
ShareWhatsApp
Related stories