When Generative AI Writes Test Cases: Scenario-Driven Evaluation of Generated Tests
This paper introduces a scenario-driven evaluation methodology to compare GenAI-generated test suites against human-written ones, revealing that while direct prompts recover more expected behaviors, ideate-then-implement strategies yield more efficient suites with fewer duplicates, and ideate-only approaches effectively uncover additional test scenarios.