Gain speed and space with NLP in Solr #bbuzz
summary
With Apache Solr at Shopping24 an index-time pipeline drops 60 million plus product noise to scale from 3M toward 100M by storing only significant terms. A simple analyzing sentence tokenizer uses domain stopword ratio to remove SEO sentences and yields 60–80% word reduction in descriptions. For general text a tuned RAKE with overlap score propagation extracts keywords. Indexed data shrinks, query latency falls, manual evaluation shows precision preserved or improved.
AI-written summary · about
chapters (5)
related talks
33mRelevant Data Analysis: Apache Solr Analytics #bbuzz
31mScaling Facets to the Stars 🌟
26mStreamlining Property Search Across Multiple Platforms
53mVisualizing the Output of Your Search AI
30mScaling Grandma’s Hefezopf
29mBuilding Analytics Applications (...)
21m"What's in the news?" #bbuzz
22mThe Capabilities of Semantic Search