Spring Kafka and Exactly-Once-ish: Transactions, EOS, and the Remaining Gaps
read-process-write with Kafka transactions, idempotent producers, and why 'exactly once' still stops at the database unless you join the TX.
Tag
5 articles · 18 min of reading
read-process-write with Kafka transactions, idempotent producers, and why 'exactly once' still stops at the database unless you join the TX.
How LinkedIn's tangle of point-to-point data pipelines led to Kafka's commit-log abstraction, and how one internal tool became industry infrastructure.
How DoorDash built a unified, Kafka-based event pipeline named Iguazu to feed analytics and machine learning from a sprawling microservices fleet.
How LinkedIn built Apache Samza to pair with Kafka, using partitioned logs and local state to make stateful stream processing durable and rebalanceable.
Why Slack outgrew a Redis-backed job queue as its job volume and job diversity exploded, and what moving the queue to Kafka bought in return.