How BT Uses Hadoop with its CRM

on YouTube ↗12m

" summary

BT builds a multi-tenant Hadoop platform (Cloudera-based) to replace a daily ETL CMF process comparing nearly a billion records across 12 systems; first production use case is master data management for BT UK business customers. A 50-node cluster running mapreduce Java cuts the cycle from 24 to 8 hours (15x velocity), handles 5x the data and yields ~200–250% ROI. Pipeline work includes inventory-backed ultrafast broadband qualification, TV-to-network correlation, millions of 4G-in-home telemetry and local IoT (MK:Smart) integrations.

AI-written summary · about

" chapters (7)

1. 0:00Intro
2. 0:13Our purpose, goal, strategy and culture
3. 1:36Customer Expectations
4. 2:23BT Consumer Customers
5. 5:36Customer Master File ETL Pipeline
6. 7:59Projects in development
7. 11:04Data Architecture Vision

" related talks

• 57mBig Data: Threat or Opportunity?Shaun Connolly · PASS Business Analytics Conference 2013
• 23mDelivering Modern Data Stacks With dbt to Operationalise AnalyticsTim Harrison, Ernesto Ongaro · Big Data LDN 2022
• 52mUsing Hadoop at BadooValeriy Starynin · HighLoad++ 2014
• 42mBillion-Scale Triumph: Innovating at the Edge of Cloud DataBalázs Szántó · Craft Conference 2025
• 52mUsing Hadoop at BadooValeriy Starynin · HighLoad++ 2014
• 05mHadoop in 5 Minutes or LessJohn Schroeder · Strata Conference 2014
• 10mSeparating Hadoop Myths from RealityJack Norris · Strata Conference New York + Hadoop World 2013
• 47mSolving Real & Big (Data) Problems Using HadoopEva Andreasson · GOTO Chicago 2014