Hadoop Essentials for the SQL Server Professional
summary
Claims Hadoop scales to multi‑petabyte warehouses and that hdfs uses three-way block replication for fault tolerance; demonstrates YARN/tez replacing old map ruce for much faster, in‑memory execution. Shows Hive/HiveQL as SQL on files with schema on read via H catalog and external tables mapped to directories. Demo uses Horton works ambari sandbox and HD Insight to load median household income and Medicare volumes by ZIP, doubles the files and doubles the counts, and runs queries in ~9 seconds, so the build and queries succeed.
AI-written summary · about
chapters (35)
- 0:00Introduction
- 0:56Questions
- 1:37Sponsors
- 2:01Pass Summit
- 3:00Pass Community
- 3:34Speaker Introduction
- 4:03Agenda
- 5:24History of Hadoop
- 6:14Definition of Hadoop
- 7:01HDFS
- 8:45Replication
- 10:02Fault Tolerance
- 11:58Name Node
- 13:15MapReduce
- 15:55Application Master
- 18:16Microprocessing
- 19:28MapReduce analogy
- 21:10Hadoop Ecosystem
- 23:20Onpremises Options
- 25:01Cloud Options
- 26:43Hive
- 26:56What is Hive
- 27:55HiveQL
- 29:16Hive vs Sequel Server
- 31:36HiveQL compatibility
- 32:48MapReduce and Tez
- 33:59Demo Overview
- 35:45Demo Start
- 38:34Hadoop Ecosystem Tool
- 45:04Summary
- 47:41One box vs cluster
- 51:57Can I develop reports in SSRS
- 53:21Is there a notion of a unique index
- 54:37What resources are available
- 56:57Wrap up
related talks
59mPeanut Butter and Chocolate: Integrating Hadoop with SQL Server
51mBIG DATA STORAGE & PROCESSING: Introduction to Hadoop and Its Ecosystem
08mHadoop and Big Data Hype
45mSolving Real & Big (Data) Problems Using Hadoop
07mComplementary Solutions with Hadoop
44mDeveloping for Big Data at the Intersection of Containerization and Infrastructure as Code
45mFrom Big Data to Big Information
07mindustries needing data disruption