Chuck Yarbrough, Pentaho | Hadoop Summit 2016 San Jose
summary
Pentaho explains a concrete architecture called filling the data lake that uses metadata injection to make a single dynamic transformation handle thousands of varied ingests instead of building 6,000 custom jobs. It converts raw files into Avro/optimized formats on Hadoop, supports Spark-era pipelines, and cites FINRA running a ~7 petabyte application as proof point. Reported industry data shows teams spend ~46–52% of time on prep and quality, and the blueprint claims large time and operational savings.
AI-written summary · about
chapters (11)
- 0:00Start
- 0:1901. Chuck Yarbrough, Pentaho, Visits #theCUBE!.
- 0:4002. Talk About The Changes Since The Merge With Hitachi.
- 2:0103. What Is The Next Chapter For Pentaho.
- 3:3304. What Does The Solution Look Like For Pipeline Analytics.
- 5:1705. Explain What Fill In The Data Lake Means.
- 9:2106. Do Some Of The New Data Types That Don't Have A Process.
- 10:4707. What About Getting Data Out.
- 11:3008. Is Data Cleanliness A Big Part Of This.
- 16:2209. Is The Lake Size An Issue.
- 17:2410. Explain What You're Working On At Pentaho.
