How Far Can You Get Without a GPU? A Systematic Benchmark of Lightweight Hallucination Detection Across Question Answering, Dialogue, and Summarisation
This paper systematically benchmarks five lightweight, CPU-feasible hallucination detection methods across question answering, dialogue, and summarization tasks, revealing that performance is highly task-dependent with ensemble methods excelling in QA, NLI detectors leading in dialogue, and all approaches failing significantly on summarization.