AI Briefing#etl
The latest AI and developer news about #etl, with the original source and a short summary.
The latest AI and developer news about #etl, with the original source and a short summary.
AWS Glue 6.0 has been released with a 30% price reduction and full support for Apache Iceberg v3.
Unstract, an open-source platform that extracts structured JSON data from unstructured documents using natural language prompts, has been released.
Devsisters built a near real-time metrics pipeline guaranteeing under 10 minutes of latency to enable rapid decision-making during game launches.
By bundling per-Task failure emails in Airflow into a single message, alert noise was reduced.
Oliveyoung's commerce team built a Serverless-based ranking system using AWS Glue to overcome the limitations of the existing Oracle procedure approach.
A custom connector developed for ad log filtering and branching by placement, supporting JSON filtering and sampling.
Olive Young is building out its data ecosystem, expanding from an existing IDC-based ETL structure to a cloud-based data platform leveraging GCP.
Kakao's Ad Recommendation Team shared operational insights on 'Genesis', a Kafka Connect-based ETL platform, and open-sourced 'kafka-connect-web', a web tool for pipeline management.
It supports everything from MySQL data collection to loading into other DBs, while the custom handler for shard redistribution is currently in the verification stage.