Building a Scalable Analytical Solution Using IaaS and Elasticsearch

on YouTube ↗57m

" summary

Plans and outcomes focus on building a four‑node cluster on IaaS with ARM templates, installing Java, deploying Elasticsearch, opening port 9200, and using Kibana for dashboards. A mapping strategy creates .raw not_analyzed fields, a plugin (cop) assists cluster management, and Logstash indexes about 6.6 million documents; simple queries return in tens of milliseconds and a two‑year 15M‑document query completes in roughly one second. The demonstration shows the cluster, replication and sharding working, and interactive tile‑map and time‑series visualizations rendering from the deployed system.

AI-written summary · about

" chapters (12)

1. 0:00Start
2. 6:52Agenda Moving On-Premise to Cloud
3. 8:39Infrastructure as a Service (IaaS)
4. 12:12Infrastructure as a Service (VMs)
5. 13:35Deploying to Azure How do you deploy to Azure today?
6. 15:54Cloud Models
7. 18:58Resource Groups
8. 21:25Azure Resource Manager Templates
9. 24:02Our Architecture
10. 29:15Terminology
11. 31:06Did it install
12. 31:32Search Types

" related talks

• 29mHow (not) to Scale Elasticsearch for Data Analytics!Aishwarya Sankaravadivel · Developer Summit 2020
• 28mAutomated Deployment of ElasticSearch on AWSVenkatesh Neldurg · Developer Summit 2020
• 01h 01mBest Practices With ElasticsearchRoy Russo · Devnexus 2020
• 54mScale Your Elasticsearch ClusterPhilipp Krenn · Highload fwdays'20
• 42mMake Sense of your (BIG) data!David Pilato · Codemotion Roma 2014
• 37mHow we solved for Aggregation, Search and Time Series Big Data usecases using Elasticsearch DatabaseAkbar Rangara · Data Con LA 2020
• 44mSurviving ElasticsearchVitaliy Kharytonskiy · Highload fwdays'18
• 43mCattle vs. Pets - A Cost-Effective Elasticsearch Architecture to Scale-Out...Leonardo Antônio dos Santos · SREcon25 Americas