‘Data is Rectangular’ and Other Common Misconceptions
summary
Claims that data is a graph not rectangular and that Malloy stores join topology so aggregates always correct regardless of join pattern. Malloy compiles each Malloy query into one single SQL query, reads the source exactly once, and handles nested JSON/parquet as implicit joins. Tools shown: VS Code extension (runs in-browser from GitHub), npm package, Jupyter/Python integration, BigQuery/DuckDB backends. Demo runs complex airline and map‑reduce style queries successfully in a browser.
AI-written summary · about
chapters (12)
- 0:00Introduction
- 1:05Assembly to SQL and beyond
- 2:29Malloy for data programming
- 3:52Rectangular data misconception
- 7:06Graph-based data approach
- 8:31Writing Malloy query from scratch
- 10:40Nested data and simplicity
- 12:48Malloy features and ecosystem
- 13:52Live demo in VS Code
- 16:44Reusable queries in Malloy
- 20:35Why Malloy makes data easier
- 20:56Q&A
