Flink-Kudu connector

on YouTube ↗22m

" summary

Connector that reads/writes Kudu using Flink DataSet and DataStream APIs and implements a Kudu InputFormat, a RichOutputFormat and a streaming Sink to turn Kudu tablets into Flink splits and vice versa. Supports table create and append modes, validates column counts/types on append, and demo writes two rows to a new table then reads them back. Built by interns, moving toward production readiness and submitted to Apache Bahir and published on Maven Central.

AI-written summary · about

" chapters (7)

1. 0:00Introduction and motivation
2. 1:08Big Data paradigms and CAP architecture
3. 3:59Apache Kudu overview and use cases
4. 7:34Flink-Kudu connector implementation
5. 12:13Example use cases and code demos
6. 17:55Open source contribution and future plans
7. 20:21Conclusion and Q&A

" related talks

• 25mTips and Tricks for Developing Streaming and Table ConnectorsEron Wright · Flink Forward Europe 2019
• 31mEnd-to-end Flink SQL with Schema Registry, Kafka & KuduGyula Fora, Balazs Varga · Flink Forward Global Virtual 2020
• 32mKeynote: Apache Flink - Completing Cloudera’s End to End Streaming PlatformMarton Balassi, Joseph Witt · Flink Forward Virtual 2020
• 23mBetter, Faster, Stronger Streaming: Your First Dive into Flink SQLCaito Scherr · Berlin Buzzwords 2021
• 51mStream Processing Smackdown: Kafka Streams vs. Apache FlinkViktor Gamov · Voxxed Days Ticino 2025
• 32mThe easy way to build and run Flink SQL jobs using Cloudera SQL Stream BuilderKenny Gorman · Flink Forward Global 2021
• 40mApache Kudu (incubating): Fast Analytics on Fast Data #bbuzzTodd Lipcon · Berlin Buzzwords 2016
• 12mBatch Data to Graphs: Integrating Neo4j and Flink via JDBCEugene Rubanov · NODES 2025