Twitter
Twitter's Timeline Problem: Push, Pull, and the Celebrity Edge Case
How Twitter combined fan-out-on-write and fan-out-on-read to keep timelines fast without letting celebrity accounts overwhelm the system.
3 min read
Category
6 articles
Twitter
Earlybird: Real-Time Search Over Twitter's Firehose
How Twitter built Earlybird, a Lucene-based inverted index engineered to make freshly posted tweets searchable within seconds of being sent.
3 min read
Twitter
Caching at Twitter Scale: From Memcached Forks to Owned Infrastructure
How Twitter outgrew stock Memcached, built Twemcache and the Pelikan framework, and turned caching into deliberately owned infrastructure rather than a commodity.
3 min read
Twitter
Manhattan: Twitter's Multi-Tenant Distributed Database
How Twitter replaced a patchwork of Cassandra clusters with Manhattan, a purpose-built, multi-tenant distributed database with pluggable storage engines.
3 min read
Twitter
From Ruby to the JVM: Twitter's Finagle Bet
Why the Fail Whale era pushed Twitter off a Ruby on Rails monolith toward JVM services and Finagle, its shared asynchronous RPC framework.
3 min read
Twitter
Snowflake: Twitter's Decentralized, Sortable ID Generator
How Twitter replaced a single MySQL sequence with a decentralized ID generator that packs time, machine, and sequence into a roughly sortable 64-bit ID.
3 min read