Hadoop Security: Seven Ways to Kill an Elephant

on YouTube ↗01h 09m

" summary

Claim: Hadoop distributions ship insecure defaults and show concrete failures — Kerberos is treated as a flip‑switch so teams issue long‑lived tokens, delegation tokens appear in URLs and many JDBC/Hive connections run without SSL or with null ciphers. Tools clash: Scoop2 disables security mode; Storm instances require rm -rf restarts. Real incidents include an intern’s DROP TABLE that forces a 96‑hour restore. Proposed fixes: central service layer, per‑query authorization, and GRC layered over accumulo/Tahoe proxies.

AI-written summary · about

" chapters (54)

1. 0:00Introduction
2. 2:54What is your job
3. 3:47The Sam Jackson Audience Dilemma
4. 5:40The genesis of Hadoop
5. 8:46The future of technology
6. 14:17Big data analysis
7. 16:21Big data and health care
8. 17:39Algorithmic accountability
9. 18:12Audience operating system
10. 18:59Quiz
11. 20:48The scary part
12. 21:36The rearview mirror
13. 22:04Race cars
14. 22:41Seatbelts
15. 23:03Regulators
16. 24:40Hadoop Ecosystem
17. 25:47Scoop
18. 26:16Storm
19. 27:47Overview
20. 28:17My Argument
21. 28:32Zombie vs Terrorist
22. 29:32God Mode
23. 30:08Go Game
24. 31:51Hadoop Security
25. 34:20Blade Runner
26. 35:29Monitoring
27. 36:15Lines in Gravel
28. 37:47Flume
29. 38:08StormWrite
30. 40:28Pivotal
31. 40:55Command Center
32. 43:05Authentication Perimeters
33. 44:34Domain Perimeter
34. 45:26Vulnerability Management
35. 45:58Delegation Tokens
36. 46:47JIRA
37. 47:20Cow
38. 47:51Cholera
39. 48:22ERM
40. 48:52HTTP Services
41. 49:26MapReduce
42. 49:53Public Information
43. 50:08My Brother
44. 50:20We Dont Care
45. 51:40Data Protection is Weird
46. 52:05Auto Autos
47. 52:36Big Data
48. 53:48Network System Solution
49. 54:13Why Does That Matter
50. 55:01Example
51. 56:28Future State
52. 56:59Compliance Standards
53. 57:30Data Services
54. 59:35Recap

" related talks

• 50mBabar-ians at the Gate: Data Protection at Massive ScaleDavi Ottenheimer · Black Hat USA 2014
• 10mAdding Security to HadoopEddie Garcia · Strata + Hadoop World San Jose 2015
• 31mRings of Security for Big Data in CloudRachit Arora · Big Data Conference Europe 2023
• 15mThe Future of Hadoop: What Happened & What's Possible?Doug Cutting · Strata Conference New York + Hadoop World 2013
• 03mApache Hadoop Meets CybersecurityTom Reilly, Alan Ross · Strata + Hadoop World 2016 - San Jose, California
• 34mAvoiding Big Data AntipatternsAlex Holmes · JavaOne 2015
• 01h 29mHadoop 201 -- Deeper into the ElephantRoman Shaposhnik · SpringOne2GX 2014
• 45mDeep Dive into Data Streaming SecurityOlena Kutsenko · Big Data Conference Europe 2025