Reputation-driven Decision-making in Networks of Stochastic Agents

Thispaperstudiesmulti-agentsystemsthatinvolvenetworks of self-interested agents. We propose a Markov Decision Process-derived framework, called RepNet-MDP, tailored to domains in which agent rep- utation is a key driver of the interactions between agents. The funda- mentals are based on the principles of RepNet-POMDP, a framework developed by Rens et al. [11] in 2018, but addresses its mathematical inconsistencies and alleviates its intractability by only considering fully observable environments. We furthermore use an online learning algo- rithm for finding approximate solutions to RepNet-MDPs. In a series of experiments, RepNet agents are shown to be able to adapt their own behavior to the past behavior and reliability of the remaining agents of the network. Finally, our work identifies a limitation of the framework in its current formulation that prevents its agents from learning in cir- cumstances in which they are not a primary actor.

Jaar van publicatie:2020