How I Deleted Clickstream and It Was Restored from Oblivion
summary
An engineer describes a data-platform incident where a clickstream dataset was accidentally deleted because some storage systems lacked proper data governance and processes. The talk explains which storage and processing systems were involved, how the deletion happened, and how the team recovered the clickstream data.
AI-written summary · about
chapters (7)
- 0:00Introduction
- 3:03Data deletion steps
- 7:29Binary block recovery
- 10:43New cluster setup
- 16:13Parquet file assembly
- 22:07Prevention solutions
- 24:36Q&A
related talks
16mDeleting Data at Organizational Scale
06mOoops... I Deleted the Whole Production Table. What Did I Learn From It?
37mEvolution of Data Collection in the Datalake at Samokat Infrastructure
21mHow Not to Build a Data Platform Lessons from Failure to Success
19mData etiquette in a regulated world
43mThe Death of Data: Risk, Retention, and Rot
20mData Incidents - When things go wrong
53mWhat it takes for stream data processing