~/talk

Learning FastAPI on hard-mode: getting out lots of the hardest (aw yeah, geo) data fast

Talkat PyCon AU 2023 · 2023-08-18..08-22· [python]
links:none on file
slides:none on file

Production stack: FastAPI, Pydantic v2, pyproj and shapely serving the G-NAF dataset (about 15 million records split across 203 files) with daily refreshes. Code examples show async endpoints, uvicorn hosting, and using Pydantic models for validation/serialization. GeoJSON geometries include Points, LineStrings, Polygons and quadruply nested MultiPolygons; datum conversions rely on pyproj. Claims include parallel awaiting to reduce combined latency, real responses in the 600–8000 ms range for very large feature collections, and pragmatic tradeoffs around flattened vs authority-file formats.

AI-written summary · about

  1. 0:00Introduction
  2. 1:04What this FastAPI talk covers
  3. 2:28Australian address data
  4. 4:13Australian census history
  5. 5:16National address file
  6. 6:39FastAPI basics
  7. 7:01FastAPI code walkthrough
  8. 8:28Installing FastAPI
  9. 9:10Live demo: address search
  10. 9:53Address parsing challenges
  11. 10:13Async in Python
  12. 11:40Pydantic V2 overview
  13. 13:02Pydantic validation
  14. 16:11GeoJSON standards
  15. 16:51GeoJSON structure
  16. 18:13Coordinate systems
  17. 19:58Pydantic + Shapely geometries
  18. 21:02GNAF querying
  19. 21:43Datum conversion
  20. 22:27Regional data visualization
  21. 23:10Async parallel fetching
  22. 24:12Q&A
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.