DecisionPivot: a 48-task, 40,033-item diagnostic benchmark showing item accuracy hides differences between decision models in LLM systems

DecisionPivot A diagnostic benchmark of 48 tasks and 40,033 items that shows how item accuracy alone hides large differences between decision models in LLM systems