IEEE CoG 2019 - Industry Day - Katja Hofmann (Microsoft Research)

on YouTube ↗50m

" summary

Microsoft-built Project Malmo platform exposes Minecraft as an open-source 3D RL lab (Windows/Linux/Mac, many languages) and already appears in 100+ papers; it runs simple tabular Q-learning (agent learns a cliff-walk policy after ~10 minutes) up to deep visual policies. A competition stack centers on MINERL: obtain a diamond with agents retrained from scratch, limited to four days of training on one machine and encouraged to use 60 million state-action pairs of human demonstrations; baselines and Docker submission flow are provided.

AI-written summary · about

" chapters (9)

1. 0:00Introduction and motivation
2. 2:33Project Malmo platform
3. 8:12Reinforcement learning demo
4. 16:01Human-AI collaboration study
5. 27:52AI competitions overview
6. 31:48Mineral competition details
7. 40:01Meta learning research
8. 47:46Future research directions
9. 49:51Closing and acknowledgments

" related talks

• 01h 09mMinecraft as AI Playground and LaboratoryKatja Hofmann · CHI PLAY 2019
• 28mAI and Minecraft LarsLars Gregori · Devoxx Belgium 2017
• 41mReinforcement Learning and MinecraftLars Gregori · ML Conference 2018 Spring
• 32mAI and MinecraftLars Gregori · Codemotion Amsterdam 2018
• 05mInterview withLars Grigori · Devoxx Belgium 2017
• 49mA Raspberry Pi and DeepLearning4J Brain That Plays MinecraftSimon Ritter · JavaDay Ukraine 2017
• 50mA Raspberry Pi and DeepLearning4J Brain That Plays MinecraftSimon Ritter · Devoxx Belgium 2017
• 26mChatGPT and Minecraft's diamonds playing agents: Reinforcement Learning in a nutshell with sheeprlFederico Belotti · PyCon Italia 2023