~/talk

Faster model training and experimentation with Vertex AI

Talkat Google I/O 2022 · 2022-05-11..05-12· [machine-learning, cloud-infrastructure]
slides:none on file

Shows how to convert a TensorFlow training script into a containerized Vertex AI job that runs MirroredStrategy on two V100 GPUs, reports metrics with the Hypertune library, and launches a serverless hyperparameter tuning sweep via the Vertex AI Python SDK. Example builds a horses-vs-humans classifier, runs six trials (configurable) exploring learning rate, momentum and hidden units, returns a best validation accuracy ~0.82, and demonstrates that multi-GPU training plus automated tuning shortens iteration time and produces an actionable hyperparameter setting.

AI-written summary · about

  1. 0:00Introduction to Vertex AI
  2. 2:39Vertex AI and use case
  3. 5:20Distributed training concepts
  4. 6:53Environment setup
  5. 9:57Preparing training code
  6. 13:24Implementing distributed training
  7. 15:22Hyperparameter tuning setup
  8. 19:16Containerizing the code
  9. 22:47Launching the tuning job
  10. 26:43Tuning strategy
  11. 29:17Reviewing tuning results
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.