AI Briefing#kafka
The latest AI and developer news about #kafka, with the original source and a short summary.
The latest AI and developer news about #kafka, with the original source and a short summary.
SSE adoption reduces polling load, while a zero-payload design resolves loss and ordering issues.
Targeted build planner and unified scheduler reduce peak memory from 79 GiB to 12 GiB and median build completion delay from 7.7s to 3.3s.
Confirmed that the MSK Express Kafka transaction bottleneck lies in the coordinator and presented an optimization sequence.
The new Flink-based pipeline processes hundreds of thousands of events per second during live events with negligible errors, eliminating single points of failure in ad serving.
Olive Young enabled order cancellations during the 'Preparing for Shipment' stage, reducing customer service inquiries by 90% compared to normal levels.
Olive Young shared the necessity and design philosophy of a transitional architecture that introduced CDC and Kafka to a low-traffic SMS system.
Olive Young improved customer convenience by changing the cancellation deadline from the logistics task assignment time to the picking completion time.
This article outlines the process of redesigning the pessimistic lock strategy to prevent deadlocks during Kafka event processing.
kt cloud built Deck, a lakehouse platform that integrates distributed operational data.
Woowa Brothers has published a backend technology book based on their real-world development and operations experience.
This article covers three pitfalls in designing and operating Retry and DLT mechanisms for handling Kafka message processing failures.
Oliveyoung redesigned its pipeline with an event-driven architecture (EDA) to resolve the delays and inefficiencies in inventory data processing that arose during omnichannel expansion.
By tying together product, coupon, gift, and promotion benefit data through Kafka, delays of up to 45 minutes were cut down to a matter of seconds.
Apache Flink and RocksDB tuning enabled real-time ad impression aggregation from 1 minute to 7 days.
Netflix built real-time multimodal video search with a Cassandra-Kafka-Elasticsearch pipeline.
NotiHub stably centralized large-scale notifications using Kafka, Redis, and HPA.
By consolidating personal webhooks and scattered notification policies, they transformed them into NotiHub, controlled by the organization.
Olive Young Store split its integration approach between Redis cache and Kafka events depending on data characteristics.
This is the story of building **YoungWonHee**, an internal debugging tool that ties scattered logs together into a single request flow to quickly find the root cause of exposure issues.
Danggeun built an LLM-based Taxonomy Management System to automatically classify categories and attributes at scale.
By separating Alimtalk delivery using Spring transaction synchronization and Kafka, the team improved consistency and scalability.
Using OpenTelemetry and ClickHouse, log ingestion latency was cut to under 20 seconds and costs were reduced by 85.6%.
Pinterest built a unified CDC-based DB ingestion framework to reduce data latency and cut costs.
It uses the Outbox pattern and retries to safely synchronize external inbound-schedule information.