Micro-Partitions: Snowflake's Unit of Pruning and Clustering
Snowflake stores tables as compressed micro-partitions with per-column min/max metadata so most queries never open most files.
3 min read
Tag
3 articles · 10 min of reading
Snowflake stores tables as compressed micro-partitions with per-column min/max metadata so most queries never open most files.
Databricks built Photon as a native, vectorized engine so SQL and Spark workloads could leave interpreted row-at-a-time execution on the table.
The columnar storage and execution-tree design behind Google's Dremel engine, and how it became the foundation for BigQuery.