IBM and UC Berkeley Diagnose Why Enterprise Agents Fail Using IT-Bench and MAST
•
18
AI & ML interests
Enterprise AI and ML, Foundation Models, Responsible AI
Recent Activity
Papers
General Agent Evaluation
SPARC: Separating Perception And Reasoning Circuits for Test-time Scaling of VLMs
Articles
pinned
Running
5
BlueBench Leaderboard
🥇
An open-source benchmark for enterprise use cases.
No application file
ScarfBench
🐠
Java framework migration
Running
1
BPO Benchmark Evaluation
📊
Run BPO recruiting analytics benchmark with CUGA SDK
Running
8
Ai Atlas Nexus Capabilities
📚
Intent to AI Capability with AI Atlas Nexus
Running
17
AssetOpsBench
🚀
Generate and benchmark machine learning models with ease
Running
6
ITBench-Lite-Space
🚀
Develop and run interactive code notebooks with JupyterLab
Running
Featured
94
CUGA Agent
🤖
Configurable Generalist Agent, leader in AppWorld Benchmark
Sleeping
2
3DGrid-VQGAN Demo
🐻
SMILES to 3D grid and reconstruction comparison demo
Running
3
AssetOpsBench
📉
Evaluating Autonomous AI Agents for Industry 4.0 Tasks
Sleeping
2
SMI-TED-demo1
🦦
Generate embeddings from SMILES strings or CSV files
Running
2
Fm4m Eval Demo
👁
Running
4
FM4M-demo2
🐢
Generate and analyze molecular structures
Running
7
FM4M-demo1
🐢
Generate and analyze molecular structures
Running
README
📈
Sleeping
4
Biomed.sm.mv Te 84m
👁
Prediction task tests for biomed-multi-view models