An Empirical Study of Harness Design for Coding Agents
An ablation of planning, tools and context management configurations for coding agents.
paper
-
-
LLM Agents Do Not Reliably Follow Company Policies
A new benchmark that tests whether AI agents can follow long company policies during realistic work
-
Decomposing LLM Judge Scores Into Yes/No Questions
An LLM-judge approach that brings interpretability and actionability to your scores.
-
Heavy Thinking: A Test-Time Scaling Pattern for Hard Problems
Now we have GPT Pro at home
-
LLMs Corrupt Your Documents When You Delegate
A large-scale study on long-horizon document tasks.
-
OpenGame: Open Agentic Coding for Games
An agentic framework for end-to-end game creation
-
Self-Generated Agent Context Files Don't Help Either
Self-generated agent context files don't help.
-
Self-Generated Skills Don't Help
Curated skills boost agent performance by 16 points; self-generated ones don't help at all.
-
Generative Modelling via Drifting
A new paradigm for single-step generative modelling