A Brief History of Data
summary
Claims a continuous lineage from 1800s demographic statistics and Babbage/Lovelace’s automatic computation to punched‑card tabulators that finish the 1890 US census in a year, to ENIAC/UNIVAC and IBM’s 3.75MB 350 drive, to Ted Codd’s 1970 relational model, to the 1981 PC client‑server shift and the 1992 data warehouse, then GFS (2003) → Hadoop (2006) → NoSQL (2010) → Kafka open‑source (2011) and Apache Pinot for real‑time queries; the argument is that we now live in an era of events with Kafka as the universal data substrate where streaming first architectures replace batch.
AI-written summary · about
chapters (17)
- 0:00Introduction
- 2:08Early statistics
- 4:46Mechanical computation
- 7:05The first programmer
- 10:40Automating the census
- 12:21War and computing
- 14:29Commercial mainframes
- 18:01The mainframe era
- 21:41Relational data model
- 24:35The PC revolution
- 28:22Client-server paradigm
- 32:05The data warehouse
- 34:43The web era
- 37:23Internet and scale
- 38:26NoSQL and big data
- 42:01Era of events
- 45:33Future of streaming
related talks
46mA Brief History of Big Data
34mTales of Data Architecture Evolution
52mData Warehouse, Data Lake, Data Mesh, Oh My: The History of Data Storage
50mA Short Summary of the Last Decades of Data Management
41mOn Data: Sky above, sand below, peace within
29mThe Data Journey
26mPerception is Key: Telescopes, Microscopes and Data
46mThe Evolution of the Open Data Ecosystem