DBTB Roman Shaposhnik
summary
Conference-level takeaways: the industry is in a peak of confusion about building big-data applications while data engineering and application development merge, and platforms must enable three constituencies: developers, data scientists, ops to work efficiently. Many projects in use are Apache Software Foundation projects — for example Apache Spark is an ASF project, not a vendor product — and the deeper point is that vibrant community health, not a single silver-bullet technology, determines whether software thrives or rots.
AI-written summary · about
chapters (5)
- 0:00Introduction
- 0:20What were your thoughts on the conference
- 0:52The most interesting trend
- 1:49Avoiding an elephant
- 2:54The worst industry
related talks
38mThe Rise & Downfall of the Data Engineer REVISITED
49mdbt: A Software Engineering Approach To The Analytics Workflow
19mLessons from Building a Large-scale, Multi-cloud Data Platform at Databricks
29mThe Data Journey
46mSpark: One Tool for Everything?
01h 17mData Engineering in the AI Era: Building a Robust Foundation for AI Applications
51mPanel Debate: Rise Of The Data Engineer
12mDesigning Your Data-Centric Organization
