PREVIEW: Kafka Connect Best Practices

on YouTube ↗05m

" summary

Overview of the Kafka Connect framework with concrete steps: how to deploy several data integration pipelines using source and sink connectors, how to configure, manage and tune connectors for throughput and fault recovery, and how to use Kafka Streams to transform data in flight for joins and enrichment. Demonstrations use the Confluent open source platform and include tools to monitor data flow through the pipeline, connector selection criteria, and what worked during deployments.

AI-written summary · about

" chapters (4)

1. 0:00Introduction to Kafka Connect
2. 1:04Architecture and purpose
3. 3:00Data pipeline creation
4. 3:53Stream processing overview

" related talks

• 39mKafka as a Platform: The Ecosystem from the Ground UpRobin Moffatt · GOTOpia Europe 2020
• 41mKafka as a Platform: the Ecosystem from the Ground UpRobin Moffatt · ApacheCon@Home 2021
• 06mJay Kreps interviewJay Kreps · Data By the Bay 2016
• 50mApplication development and data in the emerging world ...Neha Narkhede · Berlin Buzzwords 2016
• 41mKafka as a Platform: The Ecosystem from the Ground UpRobin Moffatt · GOTOpia November 2020
• 03h 00mStream Processing, Going Beyond Pub/Sub with Kafka Streams and...F. Ramière, D Petisme · Devoxx France 2021
• 03mInterviewMatthias Sax · Scale By The Bay 2018
• 42mFrom zero to hero with Apache Kafka's connect APIRobin Moffatt · Berlin Buzzwords 2019