Date

Room

Students

Lecturer

Topic

Reference to textbook

Other readings

Tuesday,
September 15, 2020
8:15 – 11:15

Online

All students

Francesco Amigoni

Introduction to agents and multiagent systems

Chapter 1, Sections 12; Chapter 2, Sections 13

An interesting discussion on the role and the
potential of agentbased systems in applications has been triggered by the
following editorial:
James Handler, “Where Are All the Intelligent Agents?”, IEEE
Intelligent Systems, 22(3):23, May/June
2007.
http://ieeexplore.ieee.org/xpl/tocresult.jsp?isYear=2007&isnumber=4216968&Submit32=Go+To+Issues
An answer, which highlights the idea that agents
can be more conveniently intended as a design paradigm than as an
implementation technology, has been given by Peter McBurney and Michael Luck:
Peter McBurney, Michael Luck, “The Agents Are All Busy Doing Stuff!”,
IEEE Intelligent Systems, 22(4):67, July/August
2007.
http://ieeexplore.ieee.org/xpl/tocresult.jsp?isYear=2007&isnumber=4287261&Submit32=Go+To+Issues
(The above documents may be accessed, following the
reported links, from within the Politecnico network.)
A survey on the field of autonomous agents and
multiagent systems is reported in:
Special issue “Ten Years of Autonomous Agents and Multiagent
Systems”, AI Magazine, 33(3):11105, Fall 2012.

Wednesday, September 16, 2020
14:15 – 15:15

25.S.2 (formerly, D.0.3)

Students with odd “codice persona”
number (ending with 1, 3, 5, 7, or 9)

Francesco Amigoni

Introduction to multiagent systems, discussion



Friday, September 18, 2020
14:15 – 15:15

2.1.4 (formerly, N.1.6)

Students with even “codice persona”
number (ending with 0, 2, 4, 6, or 8)

Francesco Amigoni

Introduction to multiagent systems, discussion



Tuesday,
September 22, 2020
8:15 – 11:15

Online

All students

Francesco Amigoni

Architectures for intelligent agents

Chapter 1, Section 3

A description of Markov decision processes is
reported in the Chapter 3 of the following book:
Richard Sutton, Andrew Barto, Reinforcement Learning: An
Introduction, second edition, MIT Press, Cambridge, MA, 2018.
http://www.incompleteideas.net/book/thebook2nd.html

Wednesday, September 23, 2020
14:15 – 15:15

25.S.2 (formerly, D.0.3)

Students with odd “codice persona”
number

Francesco Amigoni

Exercises on Markov decision processes



Friday, September 25, 2020
14:15 – 15:15

2.1.4 (formerly, N.1.6)

Students with even “codice persona”
number

Francesco Amigoni

Exercises on Markov decision processes



Tuesday,
September 29, 2020
8:15 – 11:15

Online

All students

Nicola Gatti

Basics of game theory

Chapter 17

The general theme of the growing interactions
between computer science and game theory is discussed in the following
article:
Yoav Shoham, “Computer Science and Game Theory”, Communications of
the ACM, 51(8):7479, August 2008.
http://portal.acm.org/citation.cfm?id=1378704.1378721&coll=portal&dl=ACM&idx=1378704&part=periodical&WantType=periodical&title=Communications%20of%20the%20ACM&CFID=11223344&CFTOKEN=44332211
(The above document may be accessed, following the
reported link, from within the Politecnico network.)
A blog on Algorithmic Game Theory is:
The hypothesis of rationality for human players is
problematic. For an informal discussion, see for example:
Kaushik Basu, “The Traveler’s Dilemma”, Scientific American,
June 2007.
http://www.cs.virginia.edu/~robins/The_Travelers_Dilemma.pdf
The Italian translation of the same article
appeared on “Le Scienze”:
Kaushik Basu,
“Il dilemma del viaggiatore”, Le Scienze, 468, agosto 2007.
http://lescienze.espresso.repubblica.it/articolo/Il_dilemma_del_viaggiatore/1309086 The
topic is discussed also on the following forum: An introduction to the iterated prisoner’s dilemma
is available at:
http://en.wikipedia.org/wiki/Prisoner's_dilemma
A software program that demonstrates the Axelrod’s
experiments is available at:
http://www.econ.iastate.edu/tesfatsi/demos/axelrod/axelrodt.htm

Wednesday, September 30, 2020
14:15 – 15:15

25.S.2 (formerly, D.0.3)

Students with odd “codice persona”
number

Francesco Amigoni

Exercises on game theory



Friday, October 2, 2020
14:15 – 15:15

NO CLASS


Tuesday, October 6, 2020
8:15 – 11:15

Online

All students

Francesco Amigoni

Coalition formation

Chapter 8, Sections 13 (except Sections 3.2,
3.43.5)

Notes on the distributed algorithm for finding the
best coalition structure:
https://amigoni.faculty.polimi.it/teaching/NotesAAMAS20172018.pdf

Wednesday, October 7, 2020
14:15 – 15:15

25.S.2 (formerly, D.0.3)

Students with even “codice persona”
number

Francesco Amigoni

Exercises on game theory



Tuesday, October 13, 2020
8:15 – 11:15

Online

All students

Francesco Amigoni

Coalition formation
Multiagent planning

Chapter 8, Sections 13 (except Sections 3.2,
3.43.5)
Chapter 11, Sections 12, 5 (except Section 5.3)


Wednesday, October 14, 2020
14:15 – 15:15

25.S.2 (formerly, D.0.3)

All students

Francesco Amigoni

Exercises on coalition formation


Tuesday, October 20, 2020
8:15 – 11:15

Online

All students

Francesco Amigoni

Multiagent planning

Chapter 11, Sections 12, 5 (except Section 5.3)

Refer to Sections 24 of the following paper for an
exhaustive algorithm that finds the optimal joint policy for a DECPOMDP:
R. Nair, M. Tambe, M. Yokoo, D. Pynadath, and S. Marsella, “Taming
Decentralized POMDPs: Towards Efficient Policy Computation for Multiagent
Settings”, Proceedings of the International Joint Conference on Artificial
Intelligence (IJCAI), p. 705711, 2003.
http://teamcore.usc.edu/nair/publications/nairijcai03.pdf

Wednesday, October 21, 2020
14:15 – 15:15

25.S.2 (formerly, D.0.3)

All students

Francesco Amigoni

Exercises on coalition formation


Tuesday, October 27, 2020
8:15 – 11:15

Online

All students

Francesco Amigoni

Multiagent planning

Chapter 11, Sections 12, 5 (except Section 5.3)


Wednesday, October 28, 2020
14:15 – 15:15

25.S.2 (formerly, D.0.3)

All students

Francesco Amigoni

Exercises on multiagent planning



Tuesday, November 3, 2020
8:15 – 11:15

Online

All students

Francesco Amigoni

Distributed constraint optimization

Chapter 12, Sections 45 (except Section 4.1)


Wednesday, November 4, 2020
14:15 – 15:15

25.S.2 (formerly, D.0.3)

All students

Francesco Amigoni

Exercises on multiagent planning



Tuesday, November 10, 2020
8:15 – 11:15

Online

All students

Francesco Amigoni

Distributed constraint optimization

Chapter 12, Sections 45 (except Section 4.1)


Wednesday, November 11, 2020

NO CLASS


Tuesday, November 17, 2020
8:15 – 11:15

Online

All students

Nicola Gatti

Multiagent
learning

Chapter 10, Sections 13

Refer to Sections 23, 5 of the following paper for
a more complete illustration of stochastic games:
Junling Hu and Michael Wellman, “Nash QLearning
for GeneralSum Stochastic Games”, Journal of Machine Learning Research,
4:10391069, 2003.

Wednesday, November 18, 2020

NO CLASS


Tuesday, November 24, 2020
8:15 – 11:15

Online

All students

Nicola Gatti

Multiagent
learning

Chapter 10, Sections 13


Wednesday, November 25, 2020
14:15 – 15:15

Online

All students

Francesco Amigoni

Exercises on distributed constraint optimization



Tuesday,
December 1, 2020
8:15 – 11:15

Online

All students

Francesco Amigoni

Applications of multiagent systems


Slides on applications of agent systems in space by
prof. Michèle Lavagna:
https://amigoni.faculty.polimi.it/teaching/AgentsInSpace.pdf
An agentbased system for controlling a
manufacturing plant is described in:
Klaus Schild, Stefan Bussmann, “SelfOrganization in Manufacturing
Operations”, Communications of the ACM, 50(12):7479, December 2007.
http://portal.acm.org/citation.cfm?id=1323688.1323698
(The above document may be accessed, following the
reported link, from within the Politecnico network.)
Interesting applications of the agent paradigm
(although not always implemented with agent technologies) are relative to social
simulations, as in the case of the system described in (in Italian):
Pietro Terna,
Riccardo Taormina, “Modelli di simulazione con agenti intelligenti: il
sorprendente mondo dei camaleonti”, Sistemi intelligenti, XIX(3):
391426, dicembre 2007.
http://web.econ.unito.it/terna/deposito/si_rn_abm_camaleonti_terna_taormina_v2.1_post_pubblicazione.pdf
Following the same approach, there are also
agentbased models for simulating economic markets:
http://www.anl.gov/Media_Center/News/2008/DIS081114.html

Wednesday, December 2, 2020
14:15 – 15:15

Online

All students

Francesco Amigoni

Exercises on distributed constraint optimization



Tuesday,
December 8, 2020

NO CLASS


Wednesday, December 9, 2020
14:15 – 15:15

Online

All students

Francesco Amigoni

Exercises on distributed constraint optimization



Tuesday,
December 15, 2020

NO CLASS


Wednesday, December 16, 2020
14:15 – 15:15

Online

All students

Francesco Amigoni

Exercises on multiagent learning



Tuesday,
December 22, 2020
8:15 – 11:15

Online

All students

Nicola Gatti

Multiagent
learning

Chapter 10, Section 4

Slides on evolutionary game theory by prof. Nicola
Gatti:
https://amigoni.faculty.polimi.it/teaching/MultiagentLearningEvolutionaryGameTheory.pdf

Wednesday, December 23, 2020
14:15 – 15:15

Online

All students

Francesco Amigoni

There will be a class only if
needed, more information will be provided







Communication between agents
Software tools for developing agentbased systems
and introduction to JADE

The FIPA (Foundation for Intelligent Physical
Agents) site is:
http://www.fipa.org/
In particular, the specifications of the FIPA ACL
communication acts and of their semantics are collected in the following
document:
http://www.fipa.org/specs/fipa00037/SC00037J.pdf
Slides on software tools for developing agentbased
systems by Francesco Di Giunta (in Italian):
https://amigoni.faculty.polimi.it/teaching/ToolkitPerSistemiMultiagente.pdf
Slides on introduction to JADE by Francesco Di
Giunta (in Italian):
https://amigoni.faculty.polimi.it/teaching/IntroduzioneAJADE.pdf

November 18,
2020