Skywise: API challenges in a petabyte-scale platform
summary
Skywise centralizes telemetry from ~130 airlines and 9,000 aircraft into a petabyte-scale lake (about 12 petabytes reported), ingesting up to 2 TB per flight hour and modeling 400,000 parameters per aircraft. Pipelines cleanse and apply a Skywise ontology so identical objects (aircraft, flight, event) power reusable standard APIs and an app-store of custom APIs that let customers publish bespoke endpoints; result: a 33% production gain on an A350 line and scalable API-driven integrations.
AI-written summary · about
chapters (18)
- 0:00Intro
- 0:33Welcome
- 1:14Aviation world
- 1:41Data generation
- 2:26Digital transformation
- 3:09Skywise
- 3:55What is Skywise
- 5:30Challenges
- 7:05Skywise anthology
- 8:32Mobility
- 9:32Consistency
- 10:22Customer needs
- 11:08New challenge
- 11:38Custom APIs
- 13:54Two types of data platforms
- 15:52Custom API
- 17:01Market desirability
- 19:11Summary
related talks
51mSuper large, ultra fast, mega scaling cloud computing
16mScaling APIs Globally: VW Financial Services's Revolutionary Approach
25mAPIs for Business Scalability
31mOpenDataCube - Petabyte Scale Satellite Imagery Processing in Python
45mApache Spark's New Declarative Streaming Pipelines in Action
06mKeynote: APIs, the Universe, and Everything
08mRevolutionizing Data Engineering for Space Exploration
58mApisecure, 14 & 15 March 2023 - Sean Falconer, Head of Marketing at SkyflowWhat.