AI Briefing#apache-iceberg
The latest AI and developer news about #apache-iceberg, with the original source and a short summary.
The latest AI and developer news about #apache-iceberg, with the original source and a short summary.
The new runtime uses snapshots to keep cold starts at 2 seconds for images up to 2 GB, while S3 Tables now migrates Hive data to Iceberg in three steps.
The managed service handles data validation, type conversion, and compaction, allowing users to pay only for copied data without provisioning infrastructure.
The platform integrates Basin Pipelines, Catalog, and SQL to offer zero-egress-fee analytics on Apache Iceberg.
The update enables native handling of variant, geospatial, and nanosecond timestamp data types, along with deletion vectors and row lineage.
Available now in all commercial AWS Regions at no additional charge, the feature supports Aurora PostgreSQL versions 17.11+ and 18.6+.
AWS Glue 6.0 has been released with a 30% price reduction and full support for Apache Iceberg v3.
Netflix has redesigned its data migration approach from Cassandra to Iceberg to overcome the limitations of the existing Casspactor.
Amazon Redshift unveiled AWS Graviton-based RG instances, touting up to 2.2x performance over RA3.
Over 20 years, S3 has maintained API compatibility while growing to 500 trillion objects and exabyte scale.
In server log Iceberg APPEND loading tests, applying zstd level 9 reduced file size by 51.4% compared to ORC.
Shares operational experience and insights gained from adopting Apache Iceberg for DB and server log management.
At AWS re:Invent 2024, Aurora DSQL with unlimited scalability and Apache Iceberg-based S3 Tables were unveiled.
Directly loading Flink CDC into Iceberg tripled throughput compared to Kafka, while compaction strategies maintained query performance.
The team details their integration of Flink CDC with Apache Iceberg, addressing challenges in sharded table consolidation, commit conflicts, and performance optimization.