OpenSearchCon Europe 2024
as the organisers put it
Join us in Berlin on May 6 & 7 for OpenSearchCon Europe 2024! The OpenSearch community continues to expand, always welcoming new individuals, organizations, and partners into the fold, and...
who it's for
search engineers, platform engineers, observability engineers, machine learning engineers, data engineers, devops engineers, open-source maintainers
topics
hybrid search with k-NN and HNSW; retrieval-augmented generation pipelines; OpenTelemetry instrumentation for queries; Data Prepper durable ingestion; fine-tuning embeddings for vector search; OpenSearch performance benchmarking; Helm charts and OpenSearch operator; index mapping: keyword vs text; conversational search interfaces; migration from Elasticsearch to OpenSearch; security automation from logs; multi-tenant OpenSearch deployments
| title | author | length |
|---|---|---|
| Opening Remarks | Daryll Swager | 06m |
Recalls deploying Lucene 2.0 with Jive Forum and Postgres, spending five months tuning search and discovering forum tables already indexed; builds a… | ||
| Enhancing AI and LLM Systems with Hybrid Search | Ohad Levi | 37m |
Hybrid search combines keyword filters with vector retrieval to fix real errors: using k-NN and HNSW for ANN, then applying metadata pre‑filters stopped Kung… | ||
| Implementing an open-source RAG with OpenSearch | Aline Paponaud, Pietro Mele | 34m |
An open-source RAG pipeline is implemented using Langchain for orchestration and OpenSearch as the vector store, with embeddings stored as 384-dimension… | ||
| Enhance Query Execution Visibility in OS with OpenTelemetry | Siddhant Deshmukh | 18m |
Claims that query execution visibility in OpenSearch improves by instrumenting the search path with a lightweight Telemetry-otel plugin that wraps the… | ||
| A Thrilling Journey into Data-Driven Security Automation | Antony Charalambous, Patrick Lynch | 16m |
OpenSearch ingests proxy, endpoint and firewall logs into one index and drives an automation engine that performs just-in-time patching (demoed on Chrome… | ||
| Gaining Observability Into Your CI/CD Pipeline | Dotan Horovits | 35m |
Engineered CI/CD observability by instrumenting Jenkins to export env-vars, adding a summary step that emits JSON, indexing runs in OpenSearch, and building… | ||
| Persistent and performant ingestion using Data Prepper | David Venable | 25m |
Data Prepper provides durable, pluggable ingestion: an HTTP push path can persist incoming events to a Kafka buffer which responds 200 once data lands in… | ||
| Search Solutions with OpenSearch, Python, and Serverless 🐍 | Laysa Uchoa, Yuliia Barabash | 19m |
OpenSearch + Python + a simple serverless stack proves practical: a Docker OpenSearch node, FastAPI backend and React frontend index movie titles from DynamoDB… | ||
| Why OpenSearch? | Sercan Acar | 06m |
Community build claims a full rewrite of Lucene to store logs, traces, and metrics in a single index, and reports native ingestion from OpenTelemetry… | ||
| OpenSearch Performance and Monitoring | Iyad Dassouki | 04m |
Covers concrete steps to cut search load: choose field types to avoid dual indexing and unnecessary full‑text analysis, use filters to drop unneeded events… | ||
| Fine-tuning embeddings 4 vector search | Jakub Zavrel | 09m |
OpenSearch users fine-tune embeddings for RAG by generating supervised pairs from their documents with the open‑sourced impar toolkit that uses generative… | ||
| We need better docs! | Charlie Hull, Eric Pugh | 12m |
OpenSearch documentation falls behind because releases land every six weeks and writers lag code changes; current docs are fragmented across blog posts, GitHub… | ||
| Introducing Opensearch in existing multisource enterprise App | Philipp Wagner | 09m |
Case study of adding OpenSearch to an app that keeps data in Oracle DB and MongoDB without migrating: change data capture uses Debezium + Kafka CDC to stream… | ||
| Challenges in moving Gen AI apps to production | Fernando Rejon Barrera | 15m |
Company experience moving prototype generative QA into production: built an extractor plus abstractive QA over embedding vectors and layered retrieval (RAG)… | ||
| From custom Solr to out-of-the-box OpenSearch | Angel Fernando Borroy | 10m |
Long-running Solr/Lucene code and in-process indexing cause versioning and scalability pain, so the stack moves from embedded Solr to Elasticsearch and then… | ||
| OpenTelemetry + OpenSearch Integration | Lior Perry | 11m |
Shows a working OpenTelemetry → OpenSearch setup: the Otel Demo generates predetermined index schema and installs dashboards and templates, and uses data… | ||
| OSREPORT | Nicola Pagni, Alessandro Fortunati | 10m |
A plugin for OpenSearch Dashboards that already builds multi‑page PDF reports combining visualizations maps tables images text and links, with… | ||
| Delivering the next wave of innovation with OpenSearch | Mukul Karnik, Hariharan Gandhi | 46m |
OpenSearch now ships neural search v2.9 plus vector, hybrid, sparse, multimodal and conversational search, and an OpenSearch Assistant that turns natural… | ||
| How to become an OpenSearch Project repo maintainer | Daniel Doubrovkine | 41m |
OpenSearch has 113 opensearch-project repos and roughly 231 maintainers (March 2024); becoming one is concrete work: write a failing rest yaml test and run git… | ||
| Natural Language Search-Lexical and Semantic | Jon Handler | 38m |
Covers how OpenSearch moves from term matching to meaning by combining BM25 scoring with sparse vs dense embeddings, LLM-generated vectors and neural + kNN… | ||
| How SAP analyzes OpenTelemetry signals using Data Prepper | David Venable, Jannik Brand | 37m |
SAP Cloud Logging uses Data Prepper to map OpenTelemetry to OpenSearch indices, running per-customer OpenSearch clusters on Kubernetes with a reverse proxy… | ||
| RAGElo: An Elo Rating-based Evaluation Toolkit for RAG | Jakub Zavrel, Fernando Rejon Barrera | 39m |
RAGElo is an open-source toolkit that ranks RAG pipeline variants by running pairwise Elo ranking matches where an LLM judges two answers plus their retrieved… | ||
| Tune E-commerce Search For Success with Chorus & OpenSearch | Charlie Hull | 41m |
Chorus is an open‑source e‑commerce reference platform running on OpenSearch that bundles Cupid for manual judgments with Cupid, Quirky plus Smooy for query… | ||
| Multi-tenancy for all workloads | Jon Handler | 43m |
Every OpenSearch cluster is effectively multi-tenant and the recommended approach is a pragmatic siloed pooled hybrid mix: pool small tenants into single… | ||
| Unspoken overhead of the Inverted Index | Przemysław Hejman | 31m |
Explains why the inverted index is built per text field, how Lucene segments merge, and why bulk inserts help; shows analysis steps with the term vectors API… | ||
| Securing OpenSearch: Hints for avoiding common hassles | Nils Bandener | 41m |
Configures TLS, authN and authZ for OpenSearch with concrete warnings: a three‑node cluster requires about seven certificates and private keys for transport… | ||
| Migrating from Self-Managed ElasticSearch to OpenSearch | Liat Iusim | 38m |
Migrates a 50TB Elasticsearch 7.16 cluster to Amazon OpenSearch with zero downtime by running a full POC that holds all data in a staging cluster, then… | ||
| Revolutionizing Search: Unveiling Conversational Search | Lucas Jeanniot | 26m |
Shows how to wire OpenSearch to generative models using a configured ML node, a connector to an external LLM endpoint (OpenAI by example), and a RAG pipeline… | ||
| Unleash Your Cluster's Potential with OpenSearch Benchmark | Govind Kamat, Ian Hoang | 32m |
OpenSearch Benchmark (v1.5) is a client tool that runs workloads like NYC taxis, HTTP logs, geopoint, vector search and the big five to measure latency… | ||
| You can't test everything, but you should monitor it | Michael Lehr | 19m |
Warehouse downloads slow from ~12 MB/s to under 1 MB/s causing a 6‑minute job to stretch to an hour; the regression exists since 2020 — two years unnoticed —… | ||
| How to get your pull request merged | Peter Nied | 18m |
Advice: be brief, follow the repo's contributing.md and issue/pull templates, and use checklists so reviewers scan quickly. Find reviewers by inspecting commit… | ||
| User Behavior Insights | Stavros Macrakis, Eric Pugh | 38m |
An open source pipeline that actually captures granular search events is available: a client-side JS library sends impressions, mouseovers, clicks and… | ||
| OpenSearch in Kubernetes: Helm Charts and Operator | Anton Rubin | 42m |
Deploys OpenSearch on EKS using Helm charts and the OpenSearch Operator, with hands‑on cert work: cert-manager creates self‑signed CAs and obtains Let's… | ||
| nothing matches | ||