Grappling with massive data in the Public sector
summary
Government agencies once run across 100,000+ databases and now can collect “all” data, but must rethink architecture: use distributed copies for locality while keeping a single source of truth, deploy ML-powered inference and recommendation systems at the edge, and expect scale like 1 million transactions per second for profile stores. Modern moves favor cloud-native redesign over lift-and-shift is hard rehosting, require built-in security and governance, and treat hardware as ephemeral to enable real-time decisioning and measurable ROI from tiny percentage improvements.
AI-written summary · about
chapters (4)
- 0:00Start
- 0:17John Dillon
- 14:50How Has the Use and Handling of Data Changed in the Last Two to Five Years
- 23:34What Advice Would You Offer to Large Organizations That Have a Lot of Legacy Systems
related talks
42mBuilding a data infrastructure for large municipal government
14m"Big Data" and Analytics in Government
55mThe Great Data Debate 2022
27mNavigating Data's Next Great Shift
43mAnalytics capabilities architectural patterns: A journey for data-driven insights
02mHow to Manage the Changing Data Landscape
44mData Mesh: Lessons from the trenches
31mFrom Raw Data to Real Impact: Lessons from Real-World Transformations