Building a Fund Batch System with Airflow

In January 2024, KakaoBank successfully launched an innovative fund system applying cloud-native technology on public cloud. It was designed using K8s, Managed Database, distributed storage, and more, and was recognized by financial authorities as a Grade 1 electronic financial system.

The existing on-premise-based batch system had the limitation of not supporting cloud environments. To address this, KakaoBank adopted Airflow to meet essential requirements specific to the financial domain, such as auditing, access control, high availability, and data consistency.

Airflow has advantages such as being able to define complex workflows as code, ease of performing ETL and real-time monitoring, and seamless integration with various cloud infrastructures. Through this, KakaoBank was able to build an efficient data pipeline while complying with financial regulations.