Topics

(subject to change)

  • Models (MDPs, games)
  • RL (tabular methods, approximate methods)
  • Cooperative MARL (…)
  • Non-cooperative MARL (…)

Schedule

Week 1 (RL)

Tues Aug 26
LEC 1Intro
Setup env
Git & GitHub (opt)
Lit review
Thu Aug 28
LEC 2MDPs

Week 2

Tues Sept 2
NO CLASS
Thu Sept 4
LEC 2MDPs

Week 3

Tues Sept 9
LEC 2MDPs
Thu Sept 11
LEC 3Dynamic programming
HW1: DP
HW 1 Assigned

Week 4

Tues Sept 16
LEC 3Dynamic programming
Thu Sept 18
LEC 4Monte Carlo methods

Week 5

Mon Sept 22
HW 1 Due
Tues Sept 23
LEC 4Monte Carlo methods
Thu Sept 25
LEC 5TD learning
HW2: Tabular
HW 2 Assigned

Week 6

Tues Sept 30
LEC 5TD learning
Thu Oct 2
LEC 5TD learning

Week 7

Mon Oct 6
HW 2 Due
Tues Oct 7
LEC 5TD learning
Thu Oct 9
LEC 5TD learning

Week 8

Tues Oct 14
LEC 5TD learning
Thu Oct 16
LEC 5TD learning

Week 9

Tues Oct 21
NO CLASS
Thu Oct 23
LEC 6Value function approx.

Week 10

Tues Oct 28
LEC 6Policy gradient
Thu Oct 30
NO CLASS

Week 11

Tues Nov 4
NO CLASS
Thu Nov 6
LABHW3
HW3: Approx
HW 3 Assigned

Week 12

Tues Nov 11
LEC 6Policy gradient
PROJ
PROJ Assigned
Thu Nov 13
LEC 6Policy gradient

Week 13 (MARL)

Tues Nov 18
LEC 7Games
Thu Nov 20
LEC 7MARL

Week 14 (Fall Break)

Tues Nov 25
NO CLASS (Fall break)
Thu Nov 27
NO CLASS (Fall break)

Week 15

Tues Dec 2
LEC 7MARL
Thu Dec 4
PROJPresentations

Week 16

Tues Dec 9
PROJPresentations
Thu Dec 11
NO CLASS (Reading day)

Week 17 (Finals Week)

Tues Dec 16
PROJ Due