The profession of solving (the wrong problem)
summary
Concrete outcomes and methods: a classroom regression gives an A+ but misses capacity limits; a recommender stack built with a database, cron/Airflow and A/A test rejects DeepLearning for a simple next-episode heuristic that immediately boosts engagement; a Kaggle challenge is broken by brute-force seed discovery (≈4 billion seeds); food logistics improves by rephrase beans→nutrients (choose lentils nearby instead of solving NP‑hard routing); a timeseries scheduling problem gets solved by ignoring the signal and changing production to a negatively correlated product.
AI-written summary · about
chapters (28)
- 0:00Welcome
- 0:10The Profession of Solving (the Wrong Problem)
- 0:40Let's start with a true story
- 1:00Introduction - Assignment for a first year course in statistics
- 1:25Data from a gig at a local theatre
- 2:23Statistically significant result
- 3:04Realizing what went wrong
- 5:00First story - Designing a recommender system for the NPO
- 7:00Step 1: DrawPictures not DeepLearning
- 9:00Step 2: A/A test this setup!
- 9:51Step 3: alg(B) = entropy
- 10:41Step 4: More Measuring: the order!
- 11:37Step 5: Is it time for DeepLearning?
- 11:55Step 5: not DeepLearning, but DumbThinking
- 13:13Vincent's Lemma: Serendipity (The solution)
- 16:14Gotta Love Heuristics: Lessons
- 17:45Second story - 261 days: a billboard lottery
- 18:59Mathematical formulation of the billboard problem
- 20:21Rephrasing the billboard problem
- 21:21Applying rephrasing to a WHO food problem
- 25:08Third story - Kaggle's Santa Problem
- 26:52Mathematical formulation of the problem
- 27:56Everyone was solving the wrong problem
- 29:42Lessons learnt
- 30:55Last story: the condom factory
- 32:26Solution to the condom factory problem
- 33:30Parting words
- 34:40Advice
related talks
24mThe Rise of Reasoning Models
40mPuzzles, Problems, and Programs
44mAI Engineering Anti-patterns
52mLearning as a Tool for Algorithm Design and Beyond-Worst-Case Analysis
19mPractical problem solving for wicked problems
11mTransforming Problem-Solving with Data-Driven Insights
39mUnlocking reasoning in Large language models
23mSkills for debugging complex problems
