ECN-BENCH: Design, Systems Engineering, and a Forensic Audit of Multi-Agent Forecasting
The ECN-BENCH paper presents a systems engineering audit of a multi-agent forecasting testbed, revealing that LLM-based probability extraction is highly sensitive to configuration choices and evaluator selection, thereby undermining the reliability of near-uniform forecasts and limiting the statistical significance of comparative performance results.