{mirai} and {crew}: next-generation async to supercharge {promises}, Plumber, Shiny, and {targets}
summary
mirai uses NNG (nanomsg next gen) to give true event‑driven async: thousands of R processes connect brokerless, millions of tasks run with microsecond round‑trips and no polling (demo: launching 1,000,000 promises; example app does 10,000 async coin flips updating continuously). crew adds auto-scaling workers via a local R6 controller, spinning SLURM/AWS Batch workers on demand, returning mirai task objects that become promises, and plugs directly into targets and coro.
AI-written summary · about
chapters (13)
- 0:00mirai crew async intro
- 1:08Next-gen async in R
- 3:50nanonext enables mirai async
- 4:53Mirai promises Shiny speed
- 8:26Will Landau crew HPC intro
- 9:10Crew clinical trial challenges
- 11:18Auto-scaling crew mirai HPC
- 13:08Crew dynamic task pipelines
- 15:16Submit retrieve crew tasks
- 16:42Crew custom plugins
- 17:50Crew targets workflows
- 18:34mirai crew impact recap
- 18:54Q&A hardware coro
related talks
19mPurrrfectly parallel, purrrfectly distributed
43mMesh
22mAsynchronous Computing at Scale: Overview and Learning
46mDemos and Lightning Talks
30mMgmt Config: The future of your autonomous datacenter
44mFuture: Friendly Parallel and Distributed Processing in R
30mLive Demo – Develop and Deploy a Trustworthy Multi-Agent System
52mSerg Masís | AI Track | Compass AI & Data Summit 2025