Pivotal One and Agile Data Science
summary
Claims a Pivotal One PaaS that layers a data lake on Hadoop to ingest realtime, micro-batch and batch machine and human data, push computation to the data, and attach third‑party components. Describes an "Eightfold Path" workflow: problem formulation, feature engineering, model building (using libraries like MADlib), and deployment with an agile cadence of deliverables after each phase. Reports a logistic regression on a few billion rows that runs in seconds–minutes instead of hours in SAS, enabling real‑time anomaly detection and automated control triggers.
AI-written summary · about
chapters (7)
- 0:00The era of smart machines
- 1:36Data science architecture
- 2:55Extracting value from data
- 4:00The eightfold path methodology
- 6:07Future-proofing platforms
- 7:40Widespread data adoption
- 8:46Solving global infrastructure
related talks
44mPeople, Technology, Culture: How to make Data Science work
41mOn Data: Sky above, sand below, peace within
01h 26mData Driven Action: a primer on Data Science
18mT1A Business Optimization Use Cases
50mFast Analytics On Big Data
20mSucceed in the Life Sciences with R/Python and the Cloud
36mAssuring Business Outcome Through Analytics
25m"Data Science & Agile: Strategies for Working Together"