Walking Through Spring Cloud Data Flow
summary
Shows Spring Cloud Data Flow deploying and managing streaming and batch pipelines on Kubernetes and Cloud Foundry using the SCDF shell and Dashboard. Demonstrates a real-time pipeline with a Kafka binder: HTTP source → Kafka topic → JDBC sink plus a tapped filter to MongoDB, functional composition and an embedded Kafka Streams processor. Runs composed batch tasks (single-step auto-configurable), schedules them with cron, captures metrics in Wavefront, and reports job stats like 18 reads 18 writes with 2 commits and a 1s run.
AI-written summary · about
chapters (15)
- 0:00Intro
- 0:35Welcome
- 2:07What is data
- 10:04Spring Cloud Data Flow
- 13:45Demo
- 21:09Creating Tasks
- 30:59Executions
- 33:09Did it work
- 35:49Single Step Job Auto Configuration
- 37:09Task 261 Release
- 38:19Spring Cloud Data Flow Kubernetes
- 45:09MultiIO Support
- 45:19Container Registry Integration
- 46:34Learn More
- 48:09Outro
related talks
01h 06mOrchestrating Data Microservices with Spring Cloud Data Flow - Mark Pollack
30mDelivering the Power of Data Using Spring Cloud Data Flow - Gilbert Lau, Wayne Lund
52mCloud-native streaming and event-driven microservices
01h 32mCloud Native Data Flow Orchestration
32mCase Study of Batch Processing With Spring Cloud Data Flow Server in Cloud Foundry
44mData Processing With Microservices
01h 11mBootiful Stream Processing!
01h 12mCloud Event Driven Architectures with Spring Cloud Stream 2.0