Todd Goldman - BigDataNYC 2014 - theCUBE - #BigDataNYC
summary
Data integration becomes the top tool for big‑data projects as Hadoop moves from ad‑hoc sandboxes to production, with governance, lineage and data quality required to combine messy sources (example: Social Security spread across three columns in one system and one in another). Informatica pushes most transform logic down into Hadoop—95% pushdown to Hadoop—so teams reuse known graphical tooling across clusters; 100,000 Informatica developers can leverage this to turn a data swamp to data lagoon.
AI-written summary · about
chapters (10)
- 0:00Introduction and welcome
- 0:44Big data integration challenges
- 3:11Data mess and operationalization
- 5:42Shift from code jockeys to governance
- 8:32ETL vs ELT in Hadoop
- 10:59Informatica’s evolving role
- 13:23Data quality in big data
- 14:48Hadoop meets enterprise governance
- 16:52Aligning IT and business
- 17:56Hadoop’s future in enterprise
