~/talk

Training My Rival in Java: A Deep Q-Learning AI to Play Azul

Talkat Voxxed Days Ticino 2026 · 2026-02-05..02-06· [java, machine-learning]
links:none on file
slides:none on file

Built a playable Azul opponent using a Deep Q-Network (DQN) in Java with a dual-target network, a replay buffer, and a terminal UI; state encoding includes central tile counts, current player, floor line, player scores, pattern lines, wall tiles and tile bag size, action encoding is (factory, color, line), reward equals score delta minus extra floor penalties, hyperparameters include gamma=0.99 and learning rate=0.1, training saved/loaded from training.bin and occasionally behaves randomly due to epsilon-greedy.

AI-written summary · about

  1. 0:00Azul AI project intro
  2. 1:00Azul game rules
  3. 3:06Q-learning basics
  4. 7:25Deep Q-learning transition
  5. 8:51DQN neural network
  6. 12:22Game state encoding
  7. 14:31Epsilon-greedy action
  8. 15:54Training with replay buffer
  9. 16:39DQN trainer setup
  10. 18:05Reward calculation
  11. 19:09Live AI demo
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.