Real Time Investment Alerts using Apache Kafka & Spring Kafka at ING Bank
summary
Production system that matches a continuous market feed against thousands of user alerts and sends notifications in under ~200 ms end-to-end, built with Apache Kafka and Kafka Streams + Spring Kafka running in Spring Boot services. Local dev uses Docker, Confluent images and Prometheus/Grafana for metrics; messages use Avro + Schema Registry. Demo handles bursts up to 12,000 ticks/sec, performs stream joins via KTables, and runs in production at ING.
AI-written summary · about
chapters (40)
- 0:00Introduction
- 0:30Marcoss background
- 1:44About ING
- 2:23Agenda
- 3:10Disclaimer
- 4:18Regulation
- 5:17Requirement
- 5:49Mobile Investment App
- 7:44Requirements
- 8:14Why Kafka
- 9:42Customer Alerts
- 10:06Advisor Alerts
- 11:54Running IntelliJ
- 15:03Mobile Alerts
- 15:42Apple Stock
- 15:55Apple Stock Price
- 16:23Apple Stock Symbol
- 16:36Create Alert
- 16:50Create Alerts
- 17:09Control Ticks
- 17:30Stock Price
- 17:59Spring Kafka
- 18:45Notification
- 19:16Kafka Broker
- 19:39Docker Hub
- 20:15Alerts
- 21:11CPU cycles
- 21:28Kafka performance
- 22:04Docker
- 25:24Monitoring Process
- 28:08Scaling
- 28:50Kafka Metrics
- 30:06Kafka Interceptor
- 31:41Kafka Matrix
- 32:33Kafka Streams
- 36:06Kafka Code
- 36:33Kafka Configuration
- 39:29Where do you start
- 41:21Kafka
- 47:27Before using Spring Kafka
related talks
46mFast Data at ING
43mDevOps at ING Analytics
28mTransforming the Financial Services Industry with Event Stream Data
49mEnriching Kafka Applications With Real-time Contextual Data
45mApplications in the Emerging World of Stream Processing
01h 00mPutting Apache Kafka to Use
50mIntroduction to Apache Kafka
50mApplication development and data in the emerging world ...