Open Source for Energy Transition via Data Management - Eyes on a Major Prize
summary
Shell open-sources a real-time time-series ingestion platform RTDIP that funnels streaming sources (Event Hubs/Kafka) into a Delta lakehouse, exposes a Python SDK and REST APIs, and integrates with C3.ai, Microsoft and Kongsberg digital twin stacks. It already ingests from 3 million sensors and stores about 4 trillion rows of data, scales predictive maintenance from hundreds to thousands of assets, and supports cross-sector use cases (cement, steel, EV battery cooling, synthetic aviation fuel) with reported efficiency and interoperability gains.
AI-written summary · about
chapters (9)
- 0:00Open source in energy transition
- 1:50Energy transition and digitalization
- 6:24Digitalization enables decarbonization
- 12:05Transforming energy systems
- 13:31Open source's critical role
- 22:30Real-time data ingestion platform
- 29:31RTDIP core capabilities
- 32:44Interoperability for climate goals
- 39:28Q&A
related talks
30mReal Time Data Driving Innovation
21mSoftware Best Practices for Data Pipelines: Form Energy's Multi-Day Storage R&D Pipeline 🌳
47mBuilding Modern Data Streaming Apps with Open Source
35mReal-time analytics at IoT scale
42mOS-Climate: A Breakthrough Open Data and Open Source Analytics Collaboration for...
24mCreating a Data Platform for Software-Defined Electric Vehicles
27mStream, Store, Visualize: Fast-Track Real-Time Analytics the OSS Way
30mData Platform Infrastructure at Rivian: A Deep Dive