Highly available and disaster ready Apache Solr
summary
Explains concrete HA and DR features added to Apache Solr: incremental backups with checksummed index files, pluggable repository implementations (local, HDFS, upcoming GCP and S3), and backup APIs (backup, restore, list, delete) that can restore into an existing read‑only collection. Describes CDCR removal and a replacement that uses a message queue (Kafka recommended), a standalone cross‑DC consumer that mirrors requests, external versioning for multi‑way replication, tombstone-style deletes for safe undelete, and only drops 409 conflicts.
AI-written summary · about
chapters (15)
- 0:00Intro
- 1:34DR a.k.a. Disaster Recovery
- 4:30History
- 5:26Incremental Backups
- 6:54Backup/Restore
- 9:24Usage
- 12:13High Availability a.k.a. HA
- 16:54New Solr w/ Cross-DC replication architecture
- 20:29Requirements
- 21:48Ingestion of data
- 24:27Mirrored Request
- 25:40Cross-DC Consumer Standalone App
- 26:48Extendability = Flexibility
- 27:26Extending the Interface
- 28:45Road Ahead
related talks
36mSolrCloud and NoSQL
42mZero downtime index upgrade in Apache Solr
44mRiak, Redis, Apache Solr & Spark: Deploying with the Basho Data Platform
57msolr-ruby: The Best Open Source Search Engine + Ruby
08mSolr Cloud Manager
36mNew Replica Types in Solr 7 #bbuzz
01h 04mApache Lucene 8, Apache Solr and Elasticsearch – an Overview
46mMastering Snapshots in OpenSearch: From Basics To Advanced Strategi...