Data Engineers and Who Needs Them
summary
The talk discusses why large organizations need data engineers and what problems they solve when companies collect and store large volumes of data. It covers challenges around data storage, processing and use, and addresses how teams should be organized so data engineers can turn raw data into concrete products and business value.
AI-written summary · about
chapters (10)
- 0:00Introduction
- 3:01Data as strategic resource
- 9:47Data scientists vs engineers
- 17:04Building data engineering team
- 23:23ML platform example
- 26:02Data exchange system architecture
- 31:18Compliance and centralization
- 37:05Data quality parameters
- 43:18Don't reinvent the wheel
- 45:27Q&A
related talks
40mData Engineering in a Rapidly Changing World
01mData Love 2021, Apr 16th
51mPanel Debate: Rise Of The Data Engineer
22mDataEngBytes 2023 - BRI-T1-06 - Yanir Seroussi
31mThe State of Data Engineering
24mGotta Feed the Beast - Data Engineering at Scale
45mData Engineering- The Fastest Growing Tech Job
25m"Data Engineering: The World Between Worlds"
