Mastering Snapshots in OpenSearch: From Basics To Advanced Strategi...
summary
OpenSearch adds concrete snapshot features: searchable snapshots let queries run directly from S3/GCS/Azure without full restore and use caching and node roles; snapshot management (index management plugin) automates cron creation/deletion, retries and alerts; a hash prefix shard part setting spreads remote-store load to avoid throttling; a new shallow snapshot v2 makes snapshots coordination-free and zero-copy, cutting snapshot time from >1 hour for a 100-node 100k-partition cluster to under 10 seconds; cross-region repos enable simple DR.
AI-written summary · about
chapters (10)
- 0:00OpenSearch snapshots intro
- 1:47Why snapshots matter
- 4:40How snapshots work
- 10:18Snapshot best practices
- 13:05Disaster recovery with snapshots
- 15:33Cost and searchable snapshots
- 21:29Snapshot management overhead
- 25:20Hash prefix shard partitioning
- 27:49Petabyte scale performance
- 44:39Key takeaways
related talks
48mMastering OpenSearch Snapshots: From Basics To Advanced Strategies
54mRestore and Backup Elasticsearch Indices
31mSharding 2.0: Unlocking Infinite Search Scalability in OpenSearch
31mMigrating from Self managed Elasticsearch to OpenSearch & How Indias Fantasy Sports Giant Leveled Up
25mJourney To Cost-Optimized OpenSearch: A Deep Dive Into Segment Replication
31mMaximize Resource Efficiency with Separated Index and Search Workloads
19mEnhance Search Performance At Scale with
21mSQL Server 2022 – Time to Rethink your Backup and Recovery Strategy