Apache Iceberg FILE Type Spec Merged, but v4 Adoption and Engine Support Remain Incomplete
·2026.11.20 08:53
Key point
The FILE type standardizes multimodal data references with six subfields, but Iceberg v4 is still under development and engine support is in its first of eight stages.
Details
- Apache Iceberg v4 specification includes a new FILE type for standardizing references to external files like images and audio, addressing issues where file metadata was previously stored as unstructured strings.
- The FILE type defines six subfields (uri, offset, size, content_type, checksum, inline) to allow different processing engines to handle file attributes uniformly without engine-specific implementations.
- While the specification PR #17918 was merged into the main branch on October 20, 2026, Iceberg v4 has not yet been formally adopted by the Apache community.
- Implementation is at an early stage, with PR #18252 merged as the first of eight stages; remaining work includes support for Avro, Parquet, ORC, Spark, and Flink.
- The FILE type standardizes file reference information but does not guarantee file existence or manage ownership, deletion, or access controls, which remain the responsibility of the catalog and operational design.
This summary was generated automatically by AI. Check the original for the author's claims and context. Copyright belongs to the original author.
Our guide explains how the AI works. Report summary errors, attribution issues, or removal requests via Contact.