"Crawling the web with async - from the ground up!"
summary
Implements async/await for F# from scratch, building an async computation expression and the minimal runtime (a type wrapping a continuation with bind and return) that composes asynchronous steps, handles exceptions and cancellation, and compiles to JavaScript via Fable. Uses a simple HTTP proxy to fetch Wikipedia pages, chooses random links and runs multiple crawls in parallel, and shows the parallel crawler actually downloading and parsing pages. Demonstrates continuation-passing style as the underlying mechanism and the code working live.
AI-written summary · about
chapters (7)
- 0:00Introduction to async web crawling
- 6:32Parsing web pages and proxies
- 11:18Async code with continuations
- 23:10Implementing async computation type
- 26:40Monadic async with computation expressions
- 31:36Cancellation and exceptions in async
- 33:22Summary and Q&A
related talks
55mFunctional web applications using F# and suave
57mFear and Awaiting in Async: A Savage Journey to the Heart of the Coroutine Dream
01h 03mDesigning and rewriting asynchronous tasks from scratch
49mFunctional Web Development in F#
54mFunctional Web Programming in .Net with the SAFE Stack
18mA better way of doing Async Rust
20mIt's Critical: Concurrent programming as a sane programming model
01h 01mWebcrawler