Apache Pulsar: Finally an Alternative to Kafka?

on YouTube ↗45m

" summary

Apache Pulsar is presented as an alternative to Kafka and classic message queues by combining unified messaging and streaming on one broker. It uses Apache BookKeeper for durable segmented storage instead of Kafka partitions, supports elastic broker scaling and add-bookie storage growth without repartitioning, offers native geo-replication, multitenancy with quotas, per-message acknowledgements and key_shared ordering, transparent tiered storage to S3, and Kafka protocol handlers for compatibility, backed by production use since 2012 and an active open-source community.

AI-written summary · about

" chapters (11)

1. 0:00Introduction
2. 5:00Cloud-native Pulsar platform
3. 13:28Messaging vs data streaming
4. 17:45Why not Kafka for messaging
5. 18:26Pulsar scalability and elasticity
6. 23:02Segment-based storage model
7. 29:20Replication and geo-replication
8. 32:07Multitenancy in Pulsar
9. 33:10Kafka compatibility and ecosystem
10. 36:43Summary and conclusion
11. 37:27Q&A

" related talks

• 45mScalable distributed messaging&streaming with Apache PulsarJulien Jakubowski · Berlin Buzzwords 2023
• 53mEvent Messaging and Streaming with Apache PulsarMary Grygleski · Build Stuff 2022
• 46mScalable messaging and streaming with Apache PulsarJulien Jakubowski · Voxxed Days Luxembourg 2023
• 50mApache Pulsar 101: architecture and featuresSteven Le Roux, Alexandre Duval · Devoxx France 2021
• 51mApache Pulsar 101: architecture, concepts & benchmarksQuentin Adam, Steven Le Roux · Devoxx Belgium 2019
• 28mBuild your next-generation stream platform based on Apache PulsarNeng Lu · Flink Forward Virtual 2020
• 34mEvent Streaming in the Cloud Native World with Apache PulsarMary Grygleski · Cloud Builders: Java Conf 2023
• 59mEvent Streaming and Processing Using Apache PulsarMary Grygleski · IntelliJ IDEA Conf 2022