Practical Use-Cases of Solr's AutoScaling Framework #bbuzz

on YouTube ↗40m

" summary

Solr’s AutoScaling framework aims to let clusters grow to a trillion documents with minimal ops effort by using declarative policies (hard rules) and preferences (load sorting), a diagnostics API, and event-driven triggers. It adds features like auto add replicas to maintain replication after node loss, and a search rate trigger (Solr 7.3) that computes plans to add or move replicas based on QPS before optionally executing them. Experimentally killing a node keeps replication and respects AZ placement; triggers can notify via HTTP and can compute plans without auto-executing for manual validation.

AI-written summary · about

" chapters (14)

1. 0:00Intro
2. 1:30Why Auto-Scaling?
3. 2:19In a nutshell
4. 2:48Describing your cluster
5. 4:40Auto-Scaling Policies
6. 8:04Auto-Scaling Policy - API
7. 8:22Auto-Scaline Preferences
8. 12:32Auto-Scaling Preferences - API
9. 14:54Collection APIs
10. 17:04Collection Replication Factor
11. 22:10Auto-Scaling Triggers - API
12. 25:37Search Rate Trigger - API
13. 26:40Trigger Actions
14. 30:34Trigger Listener

" related talks

• 31mAutoscaling: the why, what, how & when to help you implement itAlejandro Calderon · ScaleConf Colombia 2019
• 16mAutoscaling Distributed System with BOSHYudai Iwasaki · Cloud Foundry Summit 2014
• 36mAutoscaling Search and Analytics in Kubernetes: The OpenSearch Operator AdvantagePawel Wlodarczyk · OpenSearchCon North America 2025
• 08mSolr Cloud ManagerLucky Sharma · Berlin Buzzwords 2020
• 44mRiak, Redis, Apache Solr & Spark: Deploying with the Basho Data PlatformBryan Hunt · GOTO London 2015
• 46mOperating an OpenSearch Powered E-commerce Search Engine at ScaleLucian Precup, Amine Gani · OpenSearchCon North America 2025
• 52mOperating OpenSearch at Scale: Lessons From Managing 10,000+ Clusters Across...Hariharan Gandhi · OpenSearchCon North America 2025
• 28mAutomated Deployment of ElasticSearch on AWSVenkatesh Neldurg · Developer Summit 2020