AssetOpsBench
🚀
16
Generate and benchmark machine learning models with ease
Enterprise Agents and Benchmarks
Enterprise agent ecosystem featuring AssetOpsBench (industrial) and ITBench (SRE, FinOps, CISO), CUGA to accelerate AI Automation
-
-
CUGA Agent
🤖94Configurable Generalist Agent, leader in AppWorld Benchmark
-
ITBench-Lite-Space
🚀3Develop and run interactive code notebooks with JupyterLab
-
ibm-research/AssetOpsBench
Viewer • Updated • 152 • 820 • 9 -
ibm-research/ITBench-Lite
Updated • 9.11k • 5 -
ibm-research/ITBench-Trajectories
Updated • 96 • 3 -
AssetOpsBench: Benchmarking AI Agents for Task Automation in Industrial Asset Operations and Maintenance
Paper • 2506.03828 • Published • 16 -
ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks
Paper • 2502.05352 • Published • 1 -
Survey on Evaluation of LLM-based Agents
Paper • 2503.16416 • Published • 96