Architecture and Tools for Selected Data Integration Cases (Part 1)
summary
Covers real-world data integration use cases and their architecture, comparing protocols JDBC, HTTP and S3 and tools Debezium and StreamSets for implementing them. Explains cost-saving approaches using Spring REST and PostgREST, and focuses on data versioning and auditing with practical solutions based on database triggers and Hibernate Envers.
AI-written summary · about
chapters (9)
- 0:00Introduction
- 2:31What is data integration
- 10:20Yandex Market case
- 18:41Database-level data audit
- 21:55Integration via shared DB
- 26:35Refactoring with Dblink
- 31:56Commercial bank case
- 37:14Building a Data Lake
- 40:07Summary
related talks
31mData Unleashed: A Developer's Perspective on Navigating the Architecture Maze
40mThe Changing Face Of ETL: Event-driven Architectures for Data Engineers
41mEnterprise Integration Patterns Revisited for the Era of Big Data
01h 01mCloud Integrations, Data Architecture and MDM solutions for Enterprise Applications
41mModern Data Architectures – What They Are and How to Implement?
29mData Mesh Streaming Patterns: A Real-time Perspective
28mData Economy in Action: How to Implement Modern, Cost-Effective Data Architectures
29mEvent-First Thinking: Building Data-Driven Integration Architectures