Innovating at Scale: Lessons from Pegasystems' OpenSearch Journey
summary
Pegasystems migrates from embedded Elasticsearch to managed OpenSearch with NetApp Instaclustr, using Kafka and Cassandra as backing services, running in Pega-owned AWS/GCP accounts; production cutovers use dual-write reindexing for zero downtime, small autogenerated indexes are aggregated for performance, and the portal 26 plugin provides per-index encryption; work adds cross-region replication upstream to enable multi-region DR and the migration frees 60,000+ hours annually, covers 1,000+ nodes migrated, and supports 2M monthly users and 7B interactions per month.
AI-written summary · about
chapters (12)
- 0:00Introduction
- 2:37Pega Cloud mission
- 4:42Telecom app demo with AI
- 15:01Pega architecture and scale
- 17:55Trusted customers and search
- 19:03Embedded to externalized infrastructure
- 21:31Elasticsearch to OpenSearch migration
- 24:44OpenSearch community contributions
- 25:05NetApp Instacluster partnership
- 27:11Results and benefits
- 28:13Resources and closing
- 29:17Q&A
related talks
24mReimagining Search : Scaling OpenSearch Across an Enterprise - Platform C...
36mScaling Log Management: PB-Scale Migration From Elasticsearch To...
38mMigrating from Self-Managed ElasticSearch to OpenSearch
31mMigrating from Self managed Elasticsearch to OpenSearch & How Indias Fantasy Sports Giant Leveled Up
24mClosing Remarks & Mastering Efficiency: Pathbreaking OpenSearch Index Management (Ingestion, Index)
44mScaling OpenSearch at Uber: Operating Resilient, Fault-Tolerant, High-Performance Clus...
35mPlatformizing OpenSearch at Uber
09mIntroducing Opensearch in existing multisource enterprise App