We consider the problem of distributed convergenceto a Nash equilibrium in a noncooperative game where the playersgenerate their actions based only on online measurements oftheir individual cost functions, corrupted with additive measurementnoise. Exact analytical forms and/or parameters ofthe cost functions, as well as the current actions of the playersmay be unknown. Additionally, the players’ actions are subjectto linear dynamic constraints. We propose an algorithm basedon discrete-time stochastic extremum seeking using sinusoidalperturbations and prove its almost sure convergence to a Nashequilibrium. We show how the proposed algorithm can be appliedto solving coordination problems in mobile sensor networks,where motion dynamics of the players can be modeled as: 1) singleintegrators (velocity-actuated vehicles), 2) double integrators(force-actuated vehicles), and 3) unicycles (a kinematic modelwith nonholonomic constraints). Examples are given in which thecost functions are selected such that the problems of connectivitycontrol, formation control, rendezvous and coverage control aresolved in an adaptive and distributed way. The methodology isillustrated through simulations.
QC 20120508