Lazy Beats Smart and Fast

Julian Hyde | Architect at Looker, Creator of Apache Calcite

ABOUT THE TALK

Did you know that databases often “cheat”? Even with a scalable query engine and smart optimizer, many real-world queries would be too slow if the engine read all the data, so the engine re-writes your query to use a pre-materialized result. B-tree indexes made the first relational databases possible, and there are now many flavors of materialization, from explicit materialized views to OLAP-style caching and spatial indexes. Materialization is more relevant than ever in today’s heterogenous, distributed systems.

If you are evaluating data engines, we describe what materialization features to look for in your next engine. If you are implementing an engine, we describe the features provided by Apache Calcite to design, maintain and use materializations.

Download Slides

Julian hyde

Architect at Looker | Creator of Apache Calcite

Julian Hyde is an expert in query optimization, in-memory analytics, and streaming. He is the original developer of Apache Calcite, the query planning framework behind Apache Hive, Drill, Kylin and Phoenix, and was also the original developer of the open source Mondrian OLAP engine.

Julian Hyde