Messaging System QA: Oliveyoung's Story of Preserving Data Consistency

As Oliveyoung transitioned from an existing batch-based structure to a real-time message-based data processing structure, it faced data consistency issues where data did not match across systems. To solve this, the QA team established two strategies: UI testing and API testing.

UI testing is a basic step that verifies data loading in an actual user environment, while testing using APIs is the core strategy that verifies the entire process of data passing through multiple tables to reach the final table. This allows automatic detection of data inconsistencies at each stage.

The test automation system was built by combining the following tools.

• Postman: Writing and managing scripts that compare API response values
• Teamcity: Scheduling and managing execution of test scripts
• Datadog: Visualizing test results and alerting on anomalies

For efficient testing, after retrieving the list of changed products, product numbers are split into groups of 20 to call the API, preventing timeout issues and character limit issues in notifications while verifying consistency.