Department Home Page

Personal Home Page


Autonomous Agents and Multiagent Systems

2020-2021

Syllabus (with reading list).

 

Schedule of classes, with references to reading material and other readings.
Please check this schedule regularly, as it will be often updated!

All classes are recorded. Links to recordings are made available after the corresponding classes.

Students can participate from remote to classes in presence.

Date

Room

Students

Lecturer

Topic

Reference to textbook

Other readings

Tuesday, September 15, 2020

8:15 – 11:15

Online

All students

Francesco Amigoni

Introduction to agents and multiagent systems

Chapter 1, Sections 1-2; Chapter 2, Sections 1-3

An interesting discussion on the role and the potential of agent-based systems in applications has been triggered by the following editorial:

James Handler, “Where Are All the Intelligent Agents?”, IEEE Intelligent Systems, 22(3):2-3,  May/June 2007.

http://ieeexplore.ieee.org/xpl/tocresult.jsp?isYear=2007&isnumber=4216968&Submit32=Go+To+Issues

 

An answer, which highlights the idea that agents can be more conveniently intended as a design paradigm than as an implementation technology, has been given by Peter McBurney and Michael Luck:

Peter McBurney, Michael Luck, “The Agents Are All Busy Doing Stuff!”, IEEE Intelligent Systems, 22(4):6-7,  July/August 2007.

http://ieeexplore.ieee.org/xpl/tocresult.jsp?isYear=2007&isnumber=4287261&Submit32=Go+To+Issues

 

(The above documents may be accessed, following the reported links, from within the Politecnico network.)

 

A survey on the field of autonomous agents and multiagent systems is reported in:

Special issue “Ten Years of Autonomous Agents and Multiagent Systems”, AI Magazine, 33(3):11-105, Fall 2012.
http://www.aaai.org/ojs/index.php/aimagazine/issue/view/199/showToc

 

A blog post discussing some companies that apply multiagent approaches and technologies is available here:

https://medium.com/@Francesco_AI/distributed-artificial-intelligence-3e3491e0771c 

Wednesday, September 16, 2020

14:15 – 15:15

25.S.2 (formerly, D.0.3)

Students with odd “codice persona” number (ending with 1, 3, 5, 7, or 9)

Francesco Amigoni

Introduction to multiagent systems, discussion

 

 

Friday, September 18, 2020

14:15 – 15:15

2.1.4 (formerly, N.1.6)

Students with even “codice persona” number (ending with 0, 2, 4, 6, or 8)

Francesco Amigoni

Introduction to multiagent systems, discussion

 

 

Tuesday, September 22, 2020

8:15 – 11:15

Online

All students

Francesco Amigoni

Architectures for intelligent agents

Chapter 1, Section 3

A description of Markov decision processes is reported in the Chapter 3 of the following book:

Richard Sutton, Andrew Barto, Reinforcement Learning: An Introduction, second edition, MIT Press, Cambridge, MA, 2018.

http://www.incompleteideas.net/book/the-book-2nd.html

Wednesday, September 23, 2020

14:15 – 15:15

25.S.2 (formerly, D.0.3)

Students with odd “codice persona” number

Francesco Amigoni

Exercises on Markov decision processes

 

Friday, September 25, 2020

14:15 – 15:15

2.1.4 (formerly, N.1.6)

Students with even “codice persona” number

Francesco Amigoni

Exercises on Markov decision processes

 

 

Tuesday, September 29, 2020

8:15 – 11:15

Online

All students

Nicola Gatti

Basics of game theory

Chapter 17

The general theme of the growing interactions between computer science and game theory is discussed in the following article:

Yoav Shoham, “Computer Science and Game Theory”, Communications of the ACM, 51(8):74-79, August 2008.

http://portal.acm.org/citation.cfm?id=1378704.1378721&coll=portal&dl=ACM&idx=1378704&part=periodical&WantType=periodical&title=Communications%20of%20the%20ACM&CFID=11223344&CFTOKEN=44332211

(The above document may be accessed, following the reported link, from within the Politecnico network.)

 

A blog on Algorithmic Game Theory is:

http://agtb.wordpress.com/

 

The hypothesis of rationality for human players is problematic. For an informal discussion, see for example:

Kaushik Basu, “The Traveler’s Dilemma”, Scientific American, June 2007.

http://www.cs.virginia.edu/~robins/The_Travelers_Dilemma.pdf

The Italian translation of the same article appeared on “Le Scienze”:

Kaushik Basu, “Il dilemma del viaggiatore”, Le Scienze, 468, agosto 2007.

http://lescienze.espresso.repubblica.it/articolo/Il_dilemma_del_viaggiatore/1309086

The topic is discussed also on the following forum:
http://www.matematicamente.it/f/viewtopic.php?t=20780

 

An introduction to the iterated prisoner’s dilemma is available at:

http://en.wikipedia.org/wiki/Prisoner's_dilemma

A software program that demonstrates the Axelrod’s experiments is available at:

http://www.econ.iastate.edu/tesfatsi/demos/axelrod/axelrodt.htm

Wednesday, September 30, 2020

14:15 – 15:15

25.S.2 (formerly, D.0.3)

Students with odd “codice persona” number

Francesco Amigoni

Exercises on game theory

 

 

Friday, October 2, 2020

14:15 – 15:15

NO CLASS

Tuesday, October 6, 2020

8:15 – 11:15

Online

All students

Francesco Amigoni

Coalition formation

Chapter 8, Sections 1-3 (except Sections 3.2, 3.4-3.5)

Notes on the distributed algorithm for finding the best coalition structure:

https://amigoni.faculty.polimi.it/teaching/NotesAAMAS2017-2018.pdf

Wednesday, October 7, 2020

14:15 – 15:15

25.S.2 (formerly, D.0.3)

Students with even “codice persona” number

Francesco Amigoni

Exercises on game theory

 

 

Tuesday, October 13, 2020

8:15 – 11:15

Online

All students

Francesco Amigoni

Coalition formation

 

Multiagent planning

Chapter 8, Sections 1-3 (except Sections 3.2, 3.4-3.5)

 

Chapter 11, Sections 1-2, 5 (except Section 5.3)

 

Wednesday, October 14, 2020

14:15 – 15:15

25.S.2 (formerly, D.0.3)

All students

Francesco Amigoni

Exercises on coalition formation

Tuesday, October 20, 2020

8:15 – 11:15

Online

All students

Francesco Amigoni

Multiagent planning

Chapter 11, Sections 1-2, 5 (except Section 5.3)

Refer to Sections 2-4 of the following paper for an exhaustive algorithm that finds the optimal joint policy for a DEC-POMDP:

R. Nair, M. Tambe, M. Yokoo, D. Pynadath, and S. Marsella, “Taming Decentralized POMDPs: Towards Efficient Policy Computation for Multiagent Settings”, Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), p. 705-711, 2003.

http://teamcore.usc.edu/nair/publications/nair-ijcai03.pdf

Wednesday, October 21, 2020

14:15 – 15:15

25.S.2 (formerly, D.0.3)

All students

Francesco Amigoni

Exercises on coalition formation

Tuesday, October 27, 2020

8:15 – 11:15

Online

All students

Francesco Amigoni

Multiagent planning

Chapter 11, Sections 1-2, 5 (except Section 5.3)

 

Wednesday, October 28, 2020

14:15 – 15:15

25.S.2 (formerly, D.0.3)

All students

Francesco Amigoni

Exercises on multiagent planning

 

 

Tuesday, November 3, 2020

8:15 – 11:15

Online

All students

Francesco Amigoni

Distributed constraint optimization

Chapter 12, Sections 4-5 (except Section 4.1)

 

Wednesday, November 4, 2020

14:15 – 15:15

25.S.2 (formerly, D.0.3)

All students

Francesco Amigoni

Exercises on multiagent planning

 

 

Tuesday, November 10, 2020

8:15 – 11:15

Online

All students

Francesco Amigoni

Distributed constraint optimization

Chapter 12, Sections 4-5 (except Section 4.1)

 

Wednesday, November 11, 2020

NO CLASS

Tuesday, November 17, 2020

8:15 – 11:15

Online

All students

Nicola Gatti

Multiagent learning

Chapter 10, Sections 1-3

Refer to Sections 2-3, 5 of the following paper for a more complete illustration of stochastic games:

Junling Hu and Michael Wellman, “Nash Q-Learning for General-Sum Stochastic Games”, Journal of Machine Learning Research, 4:1039-1069, 2003.
http://www.jmlr.org/papers/volume4/hu03a/hu03a.pdf

Wednesday, November 18, 2020

NO CLASS

Tuesday, November 24, 2020

8:15 – 11:15

Online

All students

Nicola Gatti

Multiagent learning

Chapter 10, Sections 1-3

 

Wednesday, November 25, 2020

14:15 – 15:15

Online

All students

Francesco Amigoni

Exercises on distributed constraint optimization

 

 

Tuesday, December 1, 2020

8:15 – 11:15

Online

All students

Francesco Amigoni

Applications of multiagent systems

 

Slides on applications of agent systems in space by prof. Michèle Lavagna:

https://amigoni.faculty.polimi.it/teaching/AgentsInSpace.pdf

 

An agent-based system for controlling a manufacturing plant is described in:

Klaus Schild, Stefan Bussmann, “Self-Organization in Manufacturing Operations”, Communications of the ACM, 50(12):74-79, December 2007.

http://portal.acm.org/citation.cfm?id=1323688.1323698

(The above document may be accessed, following the reported link, from within the Politecnico network.)

 

Interesting applications of the agent paradigm (although not always implemented with agent technologies) are relative to social simulations, as in the case of the system described in (in Italian):

Pietro Terna, Riccardo Taormina, “Modelli di simulazione con agenti intelligenti: il sorprendente mondo dei camaleonti”, Sistemi intelligenti, XIX(3): 391-426, dicembre 2007.

http://web.econ.unito.it/terna/deposito/si_rn_abm_camaleonti_terna_taormina_v2.1_post_pubblicazione.pdf

 

Following the same approach, there are also agent-based models for simulating economic markets:

http://www.anl.gov/Media_Center/News/2008/DIS081114.html
Maria Fasli, Micheal Michalakopoulos, “e-Game: A platform for developing auction-based market simulations”, Decision Support Systems, 44(2):469-481, January 2008.
http://www.sciencedirect.com/science?_ob=MImg&_imagekey=B6V8S-4P1P6PJ-1-7&_cdi=5878&_user=2620285&_orig=search&_coverDate=01/31/2008&_sk=999559997&view=c&wchp=dGLzVtb-zSkWz&md5=2530360c00c3576692fa7ca71cf45a71&ie=/sdarticle.pdf

(The above document may be accessed, following the reported link, from within the Politecnico network.)

 

A recent and very interesting application of the agent paradigm (also in this case not implemented with agent technologies) is the High-Frequency-Trading that is substituting human brokers:

http://arstechnica.com/tech-policy/news/2009/07/-it-sounds-like-something.ars

Wednesday, December 2, 2020

14:15 – 15:15

Online

All students

Francesco Amigoni

Exercises on distributed constraint optimization

 

Tuesday, December 8, 2020

NO CLASS

Wednesday, December 9, 2020

14:15 – 15:15

Online

All students

Francesco Amigoni

Exercises on distributed constraint optimization

 

 

Tuesday, December 15, 2020

NO CLASS

Wednesday, December 16, 2020

14:15 – 15:15

Online

All students

Francesco Amigoni

Exercises on multiagent learning

 

 

Tuesday, December 22, 2020

8:15 – 11:15

Online

All students

Nicola Gatti

Multiagent learning

Chapter 10, Section 4

Slides on evolutionary game theory by prof. Nicola Gatti:

https://amigoni.faculty.polimi.it/teaching/MultiagentLearning-EvolutionaryGameTheory.pdf

 

Wednesday, December 23, 2020

14:15 – 15:15

Online

All students

Francesco Amigoni

There will be a class only if needed, more information will be provided

 

 

 

 

 

 

Communication between agents

 

Software tools for developing agent-based systems and introduction to JADE

The FIPA (Foundation for Intelligent Physical Agents) site is:

http://www.fipa.org/

In particular, the specifications of the FIPA ACL communication acts and of their semantics are collected in the following document:

http://www.fipa.org/specs/fipa00037/SC00037J.pdf

 

Slides on software tools for developing agent-based systems by Francesco Di Giunta (in Italian):

https://amigoni.faculty.polimi.it/teaching/ToolkitPerSistemiMultiagente.pdf

 

Slides on introduction to JADE by Francesco Di Giunta (in Italian):

https://amigoni.faculty.polimi.it/teaching/IntroduzioneAJADE.pdf      

 

In order to take an exam, it is mandatory to register by the deadline using Online Services. 

 

2019-2020

January 13, 2020 exam: questions (with answers).
January 30, 2020 exam: questions (with answers).

 

2018-2019

January 9, 2019 exam: questions (with answers).

February 11, 2019 exam: questions (with answers).

  

2017-2018

January 15, 2018 exam: questions (with answers).

February 6, 2018 exam: questions (with answers).

 

2016-2017

February 8, 2017 exam: questions (with answers).

March 1, 2017 exam: questions (with answers).

 

2015-2016

February 5, 2016 exam: questions (with answers).

February 29, 2016 exam: questions (with answers).

 

2014-2015

February 11, 2015 exam: questions (with answers).

March 4, 2015 exam: questions (with answers).

 

2013-2014

February 12, 2014 exam: questions (with answers).

February 27, 2014 exam: questions (with answers).

 

2012-2013

February 6, 2013 exam: questions (with answers).

February 27, 2013 exam: questions (with answers).

 

2011-2012

February 8, 2012 exam: questions (with answers).

March 7, 2012 exam: questions (with answers).

 

2010-2011

February 2, 2011 exam: questions (with answers).
February 23, 2011 exam: questions (with answers).

June 29, 2011 exam: questions (with answers).

2009-2010

February 1, 2010 exam: questions (with answers).
February 24, 2010 exam: questions (with answers).
July 5, 2010 exam: questions (with answers).
September 10, 2010 exam: questions (with answers).
September 17, 2010 exam: questions (with answers).

Sample exams from past years are available at the page of the Agenti Autonomi e Sistemi Multiagente course (in Italian).


November 18, 2020