Building Modern Data Pipelines on GCP via a FREE online Bootcamp

on YouTube ↗39m

" summary

Free online bootcamp teaches a runnable GCP pipeline that ingests multi-year flight data, profiles 30M+ user profiles and processes 100M+ streaming events using BigQuery, Dataflow (Apache Beam), Dataproc/Spark, Pub/Sub, Bigtable and Cloud Composer. Course provides GitHub exercises and a live demo that reads a 12k Thanksgiving-2019 CSV with pandas, writes parquet to Cloud Storage, creates BigQuery external tables for faster queries, and loads data into BigQuery; curriculum claims hands-on, transferable serverless skills and no signup fee.

AI-written summary · about

" chapters (6)

1. 0:00Introduction and background
2. 1:58Bootcamp goals and philosophy
3. 7:59Architecture and course structure
4. 13:45Course backstory and content
5. 15:57Live demo and technical setup
6. 29:55Q&A and closing remarks

" related talks

• 01mGoogle Cloud Platform at GoDataFest 2019Wietse Venema, Rokesh Jankie, Abishay Rao, Sebastien Fabri, Gijs Heuvingh, Merel Boers · GoDataFest 2019
• 20mStreaming Processing Options in Google CloudSergei Sokolenko · Flink Forward Europe 2019
• 55mCloud Analytics: from 0 to 100,000 events per second in 50'Didier Girard · DevFest Nantes 2016
• 41mReal-time Data Processing with Cloud DataflowFernando Ultremare · GDG Campinas Data Fest 2017
• 24mApache beam and google cloud dataflowMoshe Shamy · PyCon Israel 2017
• 44mBig Data Science on Google CloudFernando Ultremare · GDG DataFest 2018
• 56mLarge-Scale Distributed Processing in Google Cloud - 7 lessons...Bartosz Wieczorek · GeeCON 2023
• 35mPowering Interactive Data Analysis with Google BigQueryMarton Kodok · GDG DevFest Ukraine 2017