Adoption of Big Data in Securities Processing Industry A Developer's Perspective
summary
Securities-processing pipelines move from overnight 15-hour batches to sub-5-hour runs by adopting Greenplum MPP and massively parallel computation, handling workloads like 9 million accounts and ~1 million daily activities. Mutual-fund feeds scale to tens of millions of updates per day (about 10 GB) for ~700 fund families and ~725,000 distinct funds. Risk models use ~100 variables to predict settlement failures but produce ~10,000 rules that need aggregation into business-friendly signals; text work analyzes 28 companies over 7 years to surface themes.
AI-written summary · about
chapters (7)
- 0:00Introduction to Big Data
- 2:05Big Data in Securities Processing
- 6:26Portfolio Performance Computing
- 9:36Mutual Fund Data Analytics
- 12:05Text Analytics on Earnings Calls
- 14:13Settlement Risk Prediction
- 15:57Q&A Session
related talks
04mData Processing for Market Regulation
45mModern Data Architecture
24mRetail Transactions at scale for AI - From PoC to production
39mData Pipeline Evolution
24mHow To Remove Data Siloes: Tips & Considerations
11mBig Data Analytics: Immutability & Idempotence
42mWeb Development To Big Data. A Journey
10mImpacting Business as it Happens