IBM and UC Berkeley Diagnose Why Enterprise Agents Fail Using IT-Bench and MAST
•
15
AI & ML interests
Enterprise AI and ML, Foundation Models, Responsible AI
Recent Activity
View all activity
Papers
General Agent Evaluation
SPARC: Separating Perception And Reasoning Circuits for Test-time Scaling of VLMs
Articles
ibm-research/AssetOpsBench
Viewer
• Updated
• 392 • 843 • 10
ibm-research/FailureSensorIQ
Viewer
• Updated
• 8.3k • 124 • 5
ibm-research/AITQARetrieval
Viewer
• Updated
• 3.99k • 15
ibm-research/WatsonxDocsQARetrieval
Viewer
• Updated
• 1.2k • 18
ibm-research/StatCanDialogueRetrieval
Viewer
• Updated
• 7.65k • 17
ibm-research/MultiHierttRetrieval
Viewer
• Updated
• 11.9k • 22
ibm-research/OTTQASmallRetrieval
Viewer
• Updated
• 31.1k • 21
ibm-research/NQTablesRetrieval
Viewer
• Updated
• 533k • 20
ibm-research/OpenWikiTablesRetrieval
Viewer
• Updated
• 178k • 27
ibm-research/FeTaQARetrieval
Viewer
• Updated
• 24.7k • 16
ibm-research/rag-hpo-bench
Preview
• Updated
• 55 • 2
ibm-research/acp_bench
Viewer
• Updated
• 3.72k • 1.81k • 13
ibm-research/data-product-benchmark
Viewer
• Updated
• 20.8k • 845 • 3
ibm-research/dp-bench
Updated
• 84 • 1
ibm-research/ITBench-Lite
Updated
• 9.19k • 5
ibm-research/ITBench-Trajectories
Updated
• 866 • 3
ibm-research/nc-bench
Viewer
• Updated
• 720 • 48 • 1
ibm-research/ReasonLab
Viewer
• Updated
• 4.35k • 174
ibm-research/Auto-BenchmarkCard
Viewer
• Updated
• 105 • 60 • 3
ibm-research/MermaidSeqBench
Viewer
• Updated
• 132 • 67 • 5
ibm-research/knowledge_consistency_of_LLMs
Preview
• Updated
• 60 • 3
ibm-research/ToolRM-train-data
Viewer
• Updated
• 459k • 134 • 7
ibm-research/BFCL-FC-robustness
Updated
• 11
ibm-research/SQL-API-Bench
Viewer
• Updated
• 3.41k • 306 • 4
ibm-research/fc-reward-bench
Viewer
• Updated
• 1.5k • 162 • 5
ibm-research/REAL-MM-RAG_TechReport_BEIR
Viewer
• Updated
• 5.57k • 30
ibm-research/REAL-MM-RAG_TechSlides_BEIR
Viewer
• Updated
• 6.09k • 43
ibm-research/REAL-MM-RAG_FinSlides_BEIR
Viewer
• Updated
• 5.5k • 74
ibm-research/REAL-MM-RAG_FinReport_BEIR
Viewer
• Updated
• 5.27k • 50 • 1
ibm-research/Split-IFEval
Viewer
• Updated
• 541 • 984 • 1