Comparing the Scalability of Kafka and YDB Topics
summary
Compares scalability of Apache Kafka versus YDB Topics for high-throughput messaging systems, focusing on how each broker behaves when scaling. Describes practical issues encountered during expansion and contrasts architectures and scalability trade-offs to help teams choose or plan growth.
AI-written summary · about
chapters (11)
- 0:00Introduction
- 2:12YDB Topics overview
- 7:08Partition scaling issues
- 10:35Cluster storage management
- 15:53Fault tolerance on failures
- 19:24Adding new brokers
- 23:17Cluster scalability limit
- 27:50Millions of partitions comparison
- 28:52Kafka vs YDB comparison
- 33:49Q&A
- 49:14Summary
related talks
38mTransactional Work with Topics
30mAn approach to unite tables and persistent queues in one system
37mScaling Yelp’s Logging Pipeline with Apache Kafka #bbuzz
46mYDB Topic Service: How We Improved Message Queue Performance
01h 00mParallel Asynchronous Replication b/t YDB Database Instances
53mDemystifying Kafka
38mData Pipeline with Apache Kafka
38mKafka Message Broker Under High Load