A Real-World Case Study of Automated Testing Centered on CSP

Oliveyoung introduced automated testing to reduce repetitive testing resources and ensure service stability. In particular, instead of automating every feature, it defined the CSP (Critical Serving Path), the service's core path, and organized test cases around user flows to improve maintenance efficiency.

The test environment uses TeamCity as the CI/CD tool, and performs accurate testing based on real devices through Selenium and Appium. The main execution points are as follows.

• STG integration testing and regular deployment: Preventing side effects that occur during code merges and ensuring quality assurance
• Emergency/separate deployment: Minimizing deployment risk and ensuring the quality of key features
• Once every morning, daily: Early detection of operational issues such as infrastructure and back-office configuration errors

In particular, the focus goes beyond simple UI checks to verify data integrity. By fetching the stock, price, and promotion information of actually existing products through the back-office API, and then checking whether the amounts match through to the actual payment stage, serious problems such as over-ordering are being prevented.