Sami stopwords - How far have we gotten and why does it matter?
summary
Project produces JSON stopword modules for Sami and plugs into an existing JavaScript stopword library (60+ languages) and a small document/query toolkit; it uses a term frequency document frequency score, an NRK article crawler to pull bodies, and a stopper trainer that filters with a manually curated redlist. Northern Sami has ~25,000 users; work finds short NRK stubs and Norwegian mixing cause false positives, a demo extracts n‑grams and keywords successfully, and three language reviewers are needed to finish.
AI-written summary · about
chapters (7)
- 0:00Introduction
- 1:53What are stopwords
- 2:39What is it used for
- 3:20What does it consist of
- 4:36Tools
- 6:47Remaining work
- 9:00Modules
related talks
36mSAMENVATTR, or, How to Make a Text Summarization Tool for your Language of Choice
31mSAMEntics : Tools for paraphrase detection
01h 29mTricks, tips and topics in Text Analysis
38mAutomatically categorizing news articles on nrk.no
17mExploring Natural Language Processing
48mIntroduction to Natural Language Processing with Python
21mBeyond Significant Terms #bbuzz
40mThe indigenous languages technology project at NRC: An empowerment approach to language