Migrating Queries From Lens and Saved Objects -- Data Tangles To Data...
summary
Chronosphere engineers extract nested ndjson saved objects and parse KQL/DQL/Lucene shards into reproducible queries, using Jupyter notebooks to inspect attributes, building an automated conversion pipeline that parses dashboards, visualizations and alerts, maps aggregations and filters, and converts to Chronosphere spec. The migration engine uploads converted assets and in demo converts 11 dashboards and 74 of 75 alerts migrated; initial discovery and tooling iteration happens in about one-week discovery bursts and the team plans to open source the converter.
AI-written summary · about
chapters (7)
- 0:00Introduction
- 1:04Why we’re migrating
- 4:55Saved objects structure
- 10:13Untangling data systematically
- 16:23Automated conversion demo
- 18:30Key learnings
- 20:45Q&A
related talks
19mConfident Data Migration: automatic regression testing
31mA Journey of Migrating Data Platform from Data Center to Cloud
21mMigrate Data, Mesh in mind
18mOur Analytical Data Journey – from Paper to Petabytes
52mApache Lens: Cut Data Analytics Silos In Your Enterprise
28mThings I wish I knew before we decided to migrate our metrics infrastructure..
27mModernize Your Data Warehouse
33mAccidental DataOps: How we matured our organization with data, and how you can too!