~/talk

ChatGPT and Minecraft's diamonds playing agents: Reinforcement Learning in a nutshell with sheeprl

Talkat PyCon Italia 2023 · 2023-05-25..05-28· [machine-learning]
links:none on file
slides:none on file

Sheeprl is an open source Deep RL framework that runs PPO agents, uses distributed PyTorch and Lightning Fabric for multi-CPU/GPU training, and ships examples that train Pong and a Dreamer agent that crafts diamonds in Minecraft. The talk cites AlphaTensor finding a 4x4 matrix multiply that drops 49→47 multiplications, explains Reinforcement Learning Human Feedback as a three‑stage RLHF pipeline, reports Dreamer with a 15‑step horizon and ~2 days on 2 GPUs, and shows two architectures: coupled parallel workers and a decoupled env/train setup.

AI-written summary · about

  1. 0:00Start
  2. 0:35Reinforcement Learning
  3. 2:05Training Process
  4. 13:13SheepRL! - Decoupled architecture
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.