Agents ace the demo. Why do they fail in production?
If you set an AI agent on the same production task ten times, it might choose a different path each time and hit different problems. New research from IBM and Hugging Face points out that traditional benchmarks ignore this inconsistency.