~/talk

Tracking every ship in Norwegian waters

Talkat NDC Oslo 2026 · 2026-09-14..09-18· [data-engineering, cloud-infrastructure]
links:none on file
slides:none on file

Norway ingests and stores every AIS ping — about 100 million AIS messages/day and a 2005–present archive (~40 TB) — into a lakehouse on Azure Databricks with Terraform infra as code. Pipelines turn raw points into voyages, a Maru emissions model (≈330 input variables plus ML to infer missing registry fields), and a ship time‑to‑impact risk score; jobs drop from ~40h to ~4h using serverless clusters. Outputs are versioned data products, open downloads and audit‑logged APIs for municipalities and research.

AI-written summary · about

  1. 0:00Introduction to ship tracking
  2. 3:06Who we are and our mission
  3. 7:18Why data platforms matter
  4. 11:32Evolution of data platforms
  5. 12:53How a data platform works
  6. 17:55Structuring data in a lake
  7. 28:45Building our data platform
  8. 31:17Key data products we created
  9. 36:36AI in emissions modeling
  10. 38:26Risk analysis with time to impact
  11. 40:10Technical details of data processing
  12. 43:22Optimizing compute with serverless
  13. 44:03Spatial analysis with H3 hexagons
  14. 45:56Future roadmap for the platform
  15. 49:51Conclusion and Q&A
~/search
type to search 6,518 conferences, 143,918 speakers and 192,133 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
← →
on a talk: 5 seconds back / forward
0–9
on a talk: jump to 0%–90% of the recording
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.