~/talk

The Death of Data: Risk, Retention, and Rot

Talkat NDC Minnesota 2018 · 2018-05-07..05-10· [data-engineering]
slides:none on file

Argues that indiscriminate hoarding poisons machine learning and everyday lives, citing a nine‑year old job application profile that still authenticates accounts and real harms like misidentified toddlers barred from flights, wrongful background matches, and hiring denials. Notes massive data projects: 15 TB/night raw from LSST swelling to 200 PB processed and shows how noisy business logs and duplicated records bloat risk and cost. Recommends concrete steps: hire archivists, set retention policies, automate deletion and deduplicate to shrink threat surface and downstream bias.

AI-written summary · about

  1. 0:00Intro
  2. 0:37Our friend ergot
  3. 2:21Data has a sell-by date
  4. 5:18Data Hoarding
  5. 12:03The Death of Data
  6. 12:20Hold on a minute!
  7. 15:27Archives are not backups
  8. 21:11Problems
  9. 25:20800-588-2300
  10. 26:48Threat Surface
  11. 30:30BMI Case study in poisoned data
  12. 35:10Hire an Archivist
  13. 35:42Constrain storage space
  14. 36:20Train Data Retention
  15. 36:41Automate Deletion
  16. 37:30De-Duplicate
  17. 38:43Human Rights
  18. 40:43Accept Death
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.