~/talk

Solving the problems in front of you

Talkat PyData NYC 2023 · 2023-11-01..11-03· [soft-skills]
name:Randy Au
links:none on file
slides:none on file

Argues for finding the minimal right amount of upfront design and shows concrete practices: start with a working prototype against real inputs (nightly CSVs, ETL/DAGs, a simple database), timebox exploration, accept naive choices (Apache or a cloud VM) and later refactor on Google Cloud or with CDN/logging if needed, and architect for swapability with separation of concerns so pieces can be replaced. Presents the Knuth notion of a critical 3% and insists results grow over iterations: first build is disposable, second build actually works.

AI-written summary · about

  1. 0:00Introduction
  2. 1:49Large data projects pain
  3. 3:58Optimization as design
  4. 8:13Data warehouse example
  5. 12:07Overdesigning early signs
  6. 15:37Learning from hackathons
  7. 18:27Solving with constraints
  8. 21:36Architecture growth
  9. 23:21Conclusion & Q&A
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.