Open by design, open for data
summary
A 14‑ton detector generates massive raw images and a distributed metadata problem, so teams adopt NoSQL and cloud delivery, even spinning a company that later gets acquired; Hadoop’s ecosystem grows while spark displacing MapReduce becomes the practical successor and contributors rebuild a data‑prep product that started as 40 million lines of C++ into a much smaller Spark‑based stack. Industry groups publish portability specs (ODPI) and experiments show Spark driving predictive dataset distribution for LHC and a robot demo that actually beats humans at rock‑paper‑scissors.
AI-written summary · about
chapters (8)
- 0:00Intro
- 1:39The rise of Big Data
- 1:51The balooning Big Data Landscape
- 2:23The Need for Standardization
- 3:42What's next?
- 3:55Cloud is Your Platform for Innovation
- 4:40IBM's Cloud Architecture is Open by Design
- 5:02A Case Study in Innovation: IBM DataWorks
related talks
32mBig Data With Open Source Solutions
06mDriving enterprise open source adoption, from data lake to AI
06mDemocratizing Big Data and Hadoop-Based Platforms and Solutions
05mA New Approach to Big Data
05mIntel and the Role of Open Source
56mWelcome & State of Open Source Databases
34mAdvance Auto Parts and Open Source
35mTen years of building open source standards.