~/talk

Indexing and searching NuGet.org with Azure Functions and Search

Talkat NDC Oslo 2019 · 2019-06-17..06-21· [serverless, databases]
slides:none on file

Builds a reverse-package index that maps public types to NuGet package ID/version using Azure Functions and Azure Search: a NuGet catalog trigger scans the v3 catalog, timer triggers push package ops to queues, a downloader mirrors nupkgs, indexing reads PE headers with PEReader metadata (no Assembly.Load), and a custom Azure Search output binding writes documents. Full remix of the catalog (≈2.1M packages, ~4.2M catalog leaves, 8,400 pages) completes in ~12 hours versus two weeks previously, and the pipeline runs and scales independently.

AI-written summary · about

  1. 0:00Intro
  2. 3:08NuGet over time...
  3. 4:22NuGet talks to a repository
  4. 5:08V3 Protocol
  5. 7:58Catalog seems interesting!
  6. 11:28What do we need?
  7. 12:57Sounds like functions?
  8. 19:01Functions best practices
  9. 21:59Bindings
  10. 31:45We're making progress!
  11. 36:10System.Reflection. Metadata
  12. 38:02Azure Search
  13. 43:43Do one thing well
  14. 48:54HTTP trigger binding
  15. 52:26One issue left...
  16. 56:41Closing thoughts...
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.