Building a Telegram bot with Apache Kafka and ksqlDB
summary
Builds a Telegram bot in Go that ingests a CSV REST feed every three minutes via curl and kcat into Apache Kafka, normalizes records to protobuf with Schema Registry, and uses ksqlDB to create a stream, a materialized view table keyed by car park name, and both push queries (alerts when empty_places > 500) and pull queries (current empty_places lookups). Integrates Kafka Connect to sink protobuf events to Elasticsearch/Kibana for geo maps and time-series dashboards, and the demo works end-to-end.
AI-written summary · about
chapters (11)
- 0:00Introduction
- 2:28Telegram bot
- 8:30Creating a stream
- 9:00Processing the data
- 10:40Creating a new Kafka topic
- 14:50Creating a table
- 15:28Keyvalue lookup
- 16:20Running the bot
- 18:56Go code
- 20:47Kafka Connect
- 24:40Wrap up
related talks
47mBuilding a Telegram bot with Apache Kafka and ksqlDB
53mApache Kafka and KSQL in Action : Lets Build a Streaming Data Pipeline!
43mApache Kafka and KSQL in Action: Let’s Build a Streaming Data Pipeline!
44mNo More Silos: Integrating Databases and Apache Kafka
39mKafka as a Platform: The Ecosystem from the Ground Up
01h 07mKafka Streams and KSQLDB
29mGo Big with Apache Kafka
31mPractical Pipelines: A Houseplant Alerting System with ksqlDB.