A Validated Measurement Protocol for Comparable, Cost-Aware Software Testing Evaluation: A Reproducible Benchmark, an Oracle Sampling-Budget Guarantee, and a Real-Fault Validity Study, Instantiated for Quantum Programs
This paper introduces a validated, reproducible measurement protocol (QSQ-Bench and Q-EVAL) that ensures comparable, cost-aware, and construct-valid software testing evaluations by establishing statistical oracle guarantees and demonstrating its effectiveness through a comprehensive study on quantum programs and a classical system.