Dinesh Nirmal & Nancy Hensley | Hadoop Summit 2016 San Jose
summary
IBM outlines a Next Generation platform that stitches data lakes, Hadoop and Spark into a single workflow for four personas — data scientist, data engineer, CDO and business analyst — with 100+ connectors (HDFS, S3, Swift, RDBMS) and Spark as the engine. It layers governance and masking via open metadata (Apache Atlas) so lineage is tracked but hidden, offers Data Science Experience and a forthcoming Data Engineer Experience, and ties models (ML and deep learning) into real-time feedback loops.
AI-written summary · about
