QA Shortens Test Design Period to 1.4 Days with Code-Based Analysis

Details

Transitioned from speculative test design to verification based on code evidence, shortening the design period to an average of 1.4 days
Introduced code-based analysis to address the issue where 52% of tasks in the first half of 2025 took more than 4 days solely for test design
Applied the harness structure starting in July, unifying judgment criteria into four categories, resulting in an average design period reduction to 1.4 days upon the October report release
In the delivery zone transition task, 73% of the AI report matched the actual code, with developer feedback classifying 19% as corrections, 6% as additional confirmations, and 2% as unconfirmed
Leveraged RAG to address terminology discrepancies and exploration cost issues, while final judgments were verified using the code from the operational baseline branch as the single source of truth (SoT)
Established a process to organize code analysis results before planning reviews to pre-derive the test scope, leaving items without evidence as unconfirmed

Key point