Slack's Job Queue Overhaul: From Redis to Kafka
Why Slack outgrew a Redis-backed job queue as its job volume and job diversity exploded, and what moving the queue to Kafka bought in return.
4 min read
Tag
2 articles · 8 min of reading
Why Slack outgrew a Redis-backed job queue as its job volume and job diversity exploded, and what moving the queue to Kafka bought in return.
How Pinterest replaced a fragile in-memory queue with PinLater, a durable, pluggable asynchronous job execution system built to survive real production load.