#data-lakehouse
The latest AI and developer news about #data-lakehouse, with the original source and a short summary.
The latest AI and developer news about #data-lakehouse, with the original source and a short summary.
kt cloud built Deck, a lakehouse platform that integrates distributed operational data.
In server log Iceberg APPEND loading tests, applying zstd level 9 reduced file size by 51.4% compared to ORC.
The team details their integration of Flink CDC with Apache Iceberg, addressing challenges in sharded table consolidation, commit conflicts, and performance optimization.
By bundling per-Task failure emails in Airflow into a single message, alert noise was reduced.
By separating tagging logic from storage and adding a write buffer, updates were reduced by 67%.