LLM Agents Do Not Reliably Follow Company Policies
A new benchmark that tests whether AI agents can follow long company policies during realistic work
paper
-
-
Decomposing LLM Judge Scores Into Yes/No Questions
An LLM-judge approach that brings interpretability and actionability to your scores.
-
Heavy Thinking: A Test-Time Scaling Pattern for Hard Problems
Now we have GPT Pro at home
-
LLMs Corrupt Your Documents When You Delegate
A large-scale study on long-horizon document tasks.
-
OpenGame: Open Agentic Coding for Games
An agentic framework for end-to-end game creation
-
Self-Generated Agent Context Files Don't Help Either
Self-generated agent context files don't help.
-
Self-Generated Skills Don't Help
Curated skills boost agent performance by 16 points; self-generated ones don't help at all.
-
Generative Modelling via Drifting
A new paradigm for single-step generative modelling