How to Build a Scalable Serverless IoT Architecture on GCP

on YouTube ↗36m

" summary

A live demo builds a serverless IoT pipeline on Google Cloud Platform: an MQTT client sends ~2 messages/sec to Cloud IoT Core, messages are delivered to Pub/Sub, and a Dataflow (Apache Beam) job autoscaling from a few to hundreds of workers transforms and writes into BigQuery. The demo shows real-time inserts and a GROUP BY on 1.73 billion rows completing in ~3–5 seconds, demonstrating the pipeline’s scalability and end-to-end viability.

AI-written summary · about

" chapters (4)

1. 0:00Start
2. 2:21Server
3. 3:10Electrical cable
4. 32:49Graphics processing unit

" related talks

• 33mManaging IoT Storage with Google's Cloud PlatformDaniel Bergqvist, Billy Jacobson · Google I/O 2019
• 52mIoT on Google Cloud PlatformPaul Lundberg, Aaron Olson · DevFestMN 2016
• 20mStreaming Processing Options in Google CloudSergei Sokolenko · Flink Forward Europe 2019
• 35mConvergence of Serverless APIs & ComputeSarah Allen · KubeCon + CloudNativeCon Europe 2018
• 45mIoT at Google CloudPreston Holmes · Global IoT DevFest 2017
• 55mCloud Analytics: from 0 to 100,000 events per second in 50'Didier Girard · DevFest Nantes 2016
• 43mBuild and deploy a serverless web app on GCPXiang Shen · Geekle Free Online DevOps+JS Conference 2020
• 40mIoT with Sigfox and Google CloudMarkku Lepisto · Google I/O 2019