CommBank's journey with AWS data marketplace
summary
Commonwealth Bank migrates 61,000 pipelines and 10 petabytes of on‑prem data to AWS in nine months with 229,000 tests, then builds a cloud‑native internal data marketplace using Amazon DataZone, Lake Formation, Iceberg formats, EMR/Redshift Serverless, SageMaker Unified Studio and EventBridge. The platform enforces federated ownership per line‑of‑business service domains, minimizes data copies by taking compute to data, provides fine‑grained access controls and self‑service discovery, and already accelerates onboarding and AI experiments.
AI-written summary · about
chapters (10)
- 0:00Introduction and speakers
- 1:07Key industry trends and challenges
- 4:22Building data marketplace on AWS
- 6:08CBA's data strategy pillars
- 9:43Data gravity and migration to AWS
- 11:15Federated data topology design
- 17:38Tech stack and AWS services
- 21:30Enabling self-service analytics
- 25:07Learnings and transformation insights
- 26:53Key takeaways and conclusion
related talks
51mIncreasing Productivity and Reducing Costs in Big Data Ecosystems on AWS
17mHow ANZ Bank is using cloud to enable digital transformation
22mFireside Chat with AWS
03mThe enterprise data cloud
43mAccelerating innovation with third-party solutions on
28mHow Stockland accelerated data-driven insights on AWS
29mHow financial services companies derive greater value from data with AWS
36maccelerates its modernization journey with