No JVM, no Kafka: the future of streaming data pipelines
summary
Claims a working real‑time price recommendation pipeline built without JVM or Kafka using Supabase → Glassflow → OpenAI, created via web UI or Python SDK in minutes and processing events in milliseconds; demo shows four insert events flowing through a transformer that calls OpenAI and posts outputs to a webhook. Uses NATS/Docker/Kubernetes under the hood, supports custom Python transformers and SDK, and claims horizontal scale to billions of records. no JVM, no Kafka Python‑centric serverless pipelines
AI-written summary · about
chapters (10)
- 0:00Real-time streaming pipelines
- 1:06Bob's streaming challenge
- 3:17Batch vs streaming
- 5:27Kafka complexity issues
- 8:20Managed Kafka limits
- 10:44Python alternatives
- 13:35GlassFlow benefits
- 17:50Price recommendation demo
- 25:23GlassFlow cost efficiency
- 26:50Key takeaways
related talks
47mBuilding Modern Data Streaming Apps with Open Source
44mProcess and analyze millions of events per second with open source tools
39mStreaming doesn’t have to be hard
21mStreaming DataFrames: A New Way to Process Streaming Data
53mApache Kafka and KSQL in Action : Lets Build a Streaming Data Pipeline!
28mApache NiFi, Kafka, RisingWave, Iceberg + Stock Data
14mStreaming Data Pipelines to Enhance Real-Time Decision-Making
27mStream, Store, Visualize: Fast-Track Real-Time Analytics the OSS Way