~/talk

Training My Rival in Java: A Deep Q-Learning AI to Play Azul

Talkat Voxxed Days CERN 2026 · on Tuesday, 2026-02-10· [machine-learning, java]
links:none on file
slides:none on file

Built a Deep Q-Network in Java (no PyTorch or TensorFlow) that encodes Azul state and actions (factories or center, color, target row, wall, pattern lines, tile bag size) and trains with a replay buffer and target network. Uses epsilon-greedy 0.8→decay exploration, gamma 0.99 discount, reward = round score delta minus floor penalties. Checkpoints save every 1,000 games to training.bin and the AI plays reasonably against a human in the demo.

AI-written summary · about

  1. 0:00Azul AI project intro
  2. 1:04Azul game rules and implementation
  3. 5:00Q-learning and neural basics
  4. 7:27Dueling DQN architecture
  5. 9:37DQN agent and hyperparameters
  6. 12:04State encoding and action policy
  7. 13:55Training process and rewards
  8. 15:24Live demo: human vs AI
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.