LLM Agents Do Not Reliably Follow Company Policies
A new benchmark that tests whether AI agents can follow long company policies during realistic work
Notes tagged AgenticFailureModes
-
-
LLMs Corrupt Your Documents When You Delegate
A large-scale study on long-horizon document tasks.
-
Self-Generated Agent Context Files Don't Help Either
Self-generated agent context files don't help.
-
Self-Generated Skills Don't Help
Curated skills boost agent performance by 16 points; self-generated ones don't help at all.