Growing insights through hybrid data architectures
summary
Covers concrete patterns and tools for hybrid data: Amazon AppFlow ingests from 60+ apps to S3 or Snowflake and enabled a Salesforce-to-datalake pipeline in weeks for one customer; streaming architectures use MSK/Kinesis or partner Kafka with an example of 2,500 streaming sources feeding Redshift; catalog and quality use AWS Glue and AWS Glue Data Quality (Deequ) to flag issues before consumption; analytics use Athena federated queries and QuickSight at scale, with a cited 43% cost reduction in cost-per-query.
AI-written summary · about
chapters (15)
- 0:00Start
- 1:48Top customer needs
- 7:22End to end data strategy
- 8:13Amazon Appflow
- 12:23Orion real-time Data-as-a-Service
- 13:40Amazon S3 the core of your data ecosystem
- 14:42Your choice of Amazon S3 storage classes
- 17:03AWS Glue Data Catalog example
- 18:02AWS Glue Data Catalog with Snowflake
- 19:34AWS Glue Data Quality
- 21:13AWS Glue Data Catalog with Data Quality
- 22:43Amazon Athena
- 23:23Federated Query
- 24:33Amazon QuickSight
- 27:12Summary
related talks
28mTurn Data Into Insights
59mModern data lakes with Lake Formation, Amazon Redshift & AWS Glue
29mSimplifying data flows
39mCrafting modern data platforms: reveal your data value
42mTransform your data approach: Develop a modern data strategy
43mAnalytics capabilities architectural patterns: A journey for data-driven insights
56mUnderstanding and achieving a modern data architecture
43mData warehousing reinvented for today's needs
