Multi-Cluster Warehouses: Snowflake's Answer to Concurrency Spikes
How Snowflake scales a virtual warehouse out with extra clusters so queued queries get hardware instead of waiting behind a dashboard storm.
3 min read
Tag
3 articles · 9 min of reading
How Snowflake scales a virtual warehouse out with extra clusters so queued queries get hardware instead of waiting behind a dashboard storm.
Snowflake stores tables as compressed micro-partitions with per-column min/max metadata so most queries never open most files.
Dageville et al. at SIGMOD 2016 described a warehouse that stores data in object storage and spins independent virtual warehouses for compute.