Solving Data Engineering Challenges
summary
Claims MongoDB is the persistence heart of event-driven systems and ships a MongoDB Kafka Connector that works as both sink and source using change streams to push DB mutations into Kafka in real time. Architecture uses a database-per-microservice model and a managed option MongoDB Atlas. Produced examples: price-change flow, real-time fraud prevention, time-series/IoT, and customers like TickerTech and MAN AHL ingesting up to 150,000 ticks/sec before buffering into MongoDB for analytics.
AI-written summary · about
chapters (8)
- 0:00Start
- 0:21Request Driven versus Event-Driven Architecture
- 1:45Emergence of Microservices
- 5:29Fraud Detection and Remediation
- 7:23Why Mongodb
- 7:51Mongodb's Intelligent Operational Database Platform
- 10:09Mongodb Kafka Connector
- 11:20Mongodb Connector for Apache Kafka
related talks
47mBuilding highly scalable IoT streaming solutions using Azure Event Hubs and MongoDB
44mThe Changing Face of ETL: Event-Driven Architectures for Data Engineers
26mLeveraging Data in Motion in a Cloud-first World
23mData Mesh and Data API
30mArchitecting Applications With Multiple Open-Source Big Data Technologies
39mData Streaming? I don't even know her
01h 00mPutting Apache Kafka to Use
50mApplication development and data in the emerging world ...