<  Back to the Polytechnique Montréal portal

A dynamic game model of collective choice in multi-agent systems

Rabih Salhab, Roland P. Malhame and Jérôme Le Ny

Article (2018)

Accepted Version
Terms of Use: All rights reserved.
Download (736kB)
Cite this document: Salhab, R., Malhame, R. P. & Le Ny, J. (2018). A dynamic game model of collective choice in multi-agent systems. IEEE Transactions on Automatic Control, 63(3), p. 768-782. doi:10.1109/tac.2017.2723956
Show abstract Hide abstract


Inspired by successful biological collective decision mechanisms such as honey bees searching for a new colony or the collective navigation of fish schools, we consider a scenario where a large number of agents engaged in a dynamic game have to make a choice among a finite set of different potential target destinations. Each individual both influences and is influenced by the group's decision, as represented by the mean trajectory of all agents. Agents are assumed linear and coupled through a modified form of quadratic cost, whereby the terminal cost captures the discrete choice component of the problem. Following the mean field games methodology, we identify sufficient conditions under which allocations of destination choices over agents lead to self replication of the overall mean trajectory under the best response by the agents. Importantly, we establish that when the number of agents increases sufficiently, (i) the best response strategies to the self replicating mean trajectories qualify as epsilon-Nash equilibria of the population game; (ii) these epsilon-Nash strategies can be computed solely based on the knowledge of the joint probability distribution of the initial conditions, dynamics parameters and destination preferences, now viewed as random variables. Our results are illustrated through numerical simulations.

Uncontrolled Keywords

Collective choice, discrete choice models, mean field games (MFG), multiagent systems, optimal control

Open Access document in PolyPublie
Subjects: 2500 Génie électrique et électronique > 2500 Génie électrique et électronique
Department: Département de génie électrique
Research Center: GERAD - Groupe d'études et de recherche en analyse des décisions
Grant number: 6820-2011, 435905-13
Date Deposited: 26 Mar 2018 12:02
Last Modified: 24 Oct 2018 16:12
PolyPublie URL: https://publications.polymtl.ca/2865/
Document issued by the official publisher
Journal Title: IEEE Transactions on Automatic Control (vol. 63, no. 3)
Publisher: IEEE
Official URL: https://doi.org/10.1109/tac.2017.2723956


Total downloads

Downloads per month in the last year

Origin of downloads


Repository Staff Only