20 years of wind: Auditing UK energy policy without a cluster
summary
Claims an evidence-based audit of UK energy policy shows the dash to net zero may be compromising security, reliability, and affordability, built from government datasets; pipeline ingests CSVs to parquet with strict data contracts, transforms with DuckDB on a laptop using medallion layers (bronze/silver/gold) and unit-tested Gherkin specs, materializes aggregates and views, detects network events and macro trends, runs far faster and with far fewer man‑months than the original monolithic warehouse or past PySpark efforts.
AI-written summary · about
related talks
42mFour Years of Data Mesh in Practice
37mAuditing your data and answering the question, is it the end of the day yet?
25mData Demons: Unleashing Chaos or Driving Performance?
17mDemocratising data analytics
36mThe MODERN Modern Data Stack: Building an Open Distributed Data Warehouse Beyond...
42mFour Years of Data Mesh in Practice
30mDataEngBytes 2023 - BRI-T1-08 - Ryan Boyd
17mOptimizing Data-Driven Decisions