Using Hadoop with Excel and Power BI, Plus Data Discovery 101

on YouTube ↗02h 05m

" summary

Compares Hadoop 1 (MapReduce + HDFS) to Hadoop 2 (YARN + interactive engines), provisions an HDInsight on Azure blob storage cluster (single‑node for demos, ~10 min to spin up), runs a real MapReduce word‑count using C# mapper/reducer via Hive streaming (uploads mymapper.exe/myreducer.exe, job produces part-00000 output), pulls Hive data into Excel with Power Query to Excel data model, and shows the same data via ODBC in Power BI and Tableau — demos complete and working.

AI-written summary · about

" chapters (12)

1. 0:00Introduction
2. 12:26Big Data defined
3. 22:04MapReduce and Hadoop basics
4. 30:51Hadoop 2.0 and YARN
5. 41:48Provision HDInsight cluster
6. 51:43MapReduce word count demo
7. 1:07:23Hive SQL for Hadoop BI
8. 1:24:00Power BI and Excel data model
9. 1:34:19Power Query to HDInsight
10. 1:45:44Power BI desktop/cloud
11. 1:57:47Tableau via ODBC
12. 2:03:35Summary

" related talks

• 58mBig Data Analytics with Excel 2013Peter Myers · PASS Business Analytics Conference 2013
• 11mMicrosoft & Power BIQuentin Clarks · Strata Conference 2014
• 01h 01mDrive Smarter Decisions with Microsoft HDInsightTim Mallalieu · PASS Business Analytics Conference 2013
• 50mPower BI + Azure Synapse Analytics: Beginning your journeyPatrick LeBlanc, Adam Saxton · SQLBits 2023
• 57mBig Data: Threat or Opportunity?Shaun Connolly · PASS Business Analytics Conference 2013
• 47mSolving Real & Big (Data) Problems Using HadoopEva Andreasson · GOTO Chicago 2014
• 18mEmpowering Business Through DataDeepthi Anantharam · Great Indian Developer Summit 2015
• 09mHDInsight and HadoopQuentin Clark · Strata Conference New York + Hadoop World 2013