Lonne Jaffe | Hadoop Summit 2014
summary
Syncsort says it’s seventh in Hadoop code contributions and contributed mapred 2454 to infuse its optimizer across nodes. It ships a tech preview called Project Silk that scans 100+‑line legacy SQL, visualizes joins and aggregations, and generates recommendations to recreate workloads on YARN. It offers free EMR and EC2 installs, a Dockerized bundle that runs a full Hadoop cluster on one machine, and a Sqoop patch to read mainframe data, claiming 40–60% DW offload savings.
AI-written summary · about
chapters (31)
- 0:00Introduction
- 0:28Meet the guest
- 0:53Syncsort and Hadoop
- 1:43Optimizing Hadoop performance
- 2:16Industry use cases
- 2:56Offloading legacy systems
- 4:17Project Silk preview
- 4:39Challenges in migration
- 5:22Partnerships and SQL
- 5:38Accelerating data processing
- 6:26AWS strategy
- 6:57Free tools for AWS
- 8:25Cloud integration impact
- 9:00Cloud commoditization
- 9:53New data formats
- 10:14Hadoop ecosystem growth
- 12:18Open source collaboration
- 12:49Innovation pace
- 13:57Paying customers
- 14:33Open core model
- 16:05Venture capital risks
- 16:31Investing in innovation
- 17:24Automation and devops
- 17:51Docker and portability
- 18:37Cloud portability
- 18:55Lock-in vs value
- 19:50Moving up the stack
- 20:12Syncsort overview
- 20:32Market outlook
- 20:55Investment landscape
- 21:11Closing
