The competition of assessment rules for indirect reciprocity
Introduction
In indirect reciprocity, helpful acts are returned, not by the recipient, but by third parties (Alexander, 1987, Sugden, 1986, Trivers, 1971). If Alice helps Betty, then Alice is helped in turn, not by Betty, as in direct reciprocation, but by some Conny or Claire. Indirect reciprocity has been amply documented in human populations (Camerer and Fehr, 2006, Bolton et al., 2005, Seinen and Schram, 2001, Wedekind and Milinski, 2000, Wedekind and Braithwaite, 2002). In order not to be subverted by exploiters (for instance by defectors who never help others), the help must be channelled away from them, and directed preferentially towards the helpers. For this, two requirements are needed: (a) information about previous interactions, even those in which one has not been involved; and (b) an assessment of these interactions. Thus indirect reciprocity is based on constant monitoring of the other members of the population, and on judging whether they deserve to be helped or not, or in other words whether they have a good image or not (Leimer and Hammerstein, 2001; Nowak and Sigmund, 1998a, Nowak and Sigmund, 1998b; Panchanathan and Boyd, 2003). This can be viewed as an elementary form of moral judgment. Individuals assess other players’ actions as good or bad even if they are not directly affected by them.
The most elementary way for C to assess A simply reflects whether A gave help to B or not. In the first case, A is viewed as good and in the second case as bad. But this leads to an interesting inconsistency: if C refuses to help A, then C is perceived by third parties as bad irrespective of whether the potential recipient A is good or bad. As a result, C is less likely to be helped. Acting on a moral judgment can thus be costly. This suggests that a better assessment rule should also take into account whether a refusal to help was justified or not (see Camerer and Fehr, 2006, Leimer and Hammerstein, 2001, Nowak and Sigmund, 1998a, Sugden, 1986). However, there exist several ways for doing this, and it is not clear which assessment should evolve in the long term. To give an example: should the act of helping a bad individual be considered as good or as bad?
There are many possible moral systems. How do they compare? In a first approach, we may consider three different classes of assessment rules (Brandt and Sigmund, 2004). A first-order assessment rule only takes into account whether A helps B or not. A second-order assessment rule takes also into account the image of the recipient B. A third-order assessment rule takes moreover into account the image of the donor A. A strategy in the indirect reciprocity interaction consists of an assessment rule together with an action rule telling the player which decision to take, as a donor, depending on the image of the recipient and the own image (Brandt and Sigmund, 2004, Ohtsuki and Iwasa, 2004).
Ohtsuki and Iwasa have shown that among the 4096 resulting strategies, only eight lead to a stable regime of mutual cooperation, if adopted by all members of the population. These are said to be the leading eight (Ohtsuki and Iwasa, 2004, Ohtsuki and Iwasa, 2006). Two of these strategies are based on second-order assessment, none on first-order assessment. In this context, ‘stable’ means that the corresponding population cannot be invaded by other action rules. However, this does not settle the issue whether other assessment rules can invade. In the set-up considered by Ohtsuki and Iwasa, the image of an individual is the same in the eyes of all members of the population. Clearly, this does not allow to compare different assessment rules.
If one wants to analyze the evolution of even the simplest system of morals, one has to consider the competition of several assessment rules in the population. This is what we propose to do in the present paper: we consider the two second-order assessment rules belonging to the ‘leading eight’, as well as the first-order assessment rule which only registers whether help is given or not. We find that this first-order assessment rule is eliminated (not surprisingly), and that among the second-order assessment rules, the sterner rule has a slight advantage; if it is as frequent as the other rule (or more frequent), its payoff is at least as high. Stable polymorphisms of the two second-order assessment rules exist, but interestingly, the population always converges to a state where both assessments coincide: evolution leads to moral consensus.
In the following sections, we describe the model, derive the results, and discuss both outcomes and methods.
Section snippets
The model
We consider a large, well-mixed population. From time to time, two individuals are randomly matched in a one-shot interaction, a so-called donation game. A coin toss decides who is the potential donor and the potential recipient (we suppress the ‘potential’ from now on). The donor can, at a personal cost c, provide a benefit b to the recipient, with . We shall actually assume (as is usually done) that both players are simultaneously donor and recipient: this does not affect the outcome of
Results
The determinant of the matrix is zero only on the edge between AllD and SUGDEN (i.e., if ). The dynamics on that edge is bistable, with the unstable fixed point determined by , see also Ohtsuki and Iwasa (2007).
From Eqs. (13), (14), (15), (16), it follows that, in the presence of the unconditional altruists (i.e., if ),andare always valid (see Appendix A for the detailed calculation). The proportion of nice AllD-players is somewhere
Discussion
There are several other papers highlighting the merits of KANDORI. We mention, in particular, Chalub et al. (2006) and Pacheco et al. (2006), which apply numerical simulations to a group selection scenario. We also refer to Brandt and Sigmund (2004), where two third-order rules called STANDING and JUDGING are compared (which are closely related to SUGDEN and KANDORI, respectively). It is shown that the sterner rule JUDGING has advantages compared to the milder rule STANDING, based on
Acknowledgments
We wish to thank Ulrich Berger for his useful comments. Part of this work is funded by EUROCORES TECT I-104 G15.
References (46)
- et al.
Cooperation among strangers with limited information about reputation
J. Public Econ.
(2005) - et al.
The logic of reprobation: assessment and action rules for indirect reciprocation
J. Theor. Biol.
(2004) - et al.
The good, the bad and the discriminator—errors in direct and indirect reciprocity
J. Theor. Biol.
(2006) - et al.
The evolution of norms
J. Theor. Biol.
(2006) Indirect reciprocity among imperfect individuals
J. Theor. Biol.
(2003)- et al.
Heterogeneity stabilises reciprocal altruism interaction
J. Theor. Biol.
(2001) - et al.
Evolution of indirect reciprocity by social information: the role of trust and reputation in evolution of altruism
J. Theor. Biol.
(2003) - et al.
The dynamics of indirect reciprocity
J. Theor. Biol.
(1998) - et al.
How should we define goodness?—Reputation dynamics in indirect reciprocity
J. Theor. Biol.
(2004) - et al.
The leading eight: social norms that can maintain cooperation by indirect reciprocity
J. Theor. Biol.
(2006)
Global analyses of evolutionary dynamics and exhaustive search for social norms that maintain cooperation by reputation
J. Theor. Biol.
Social norms and random matching games
Games Econ. Behav.
A tale of two defectors: the importance of standing for evolution of indirect reciprocity
J. Theor. Biol.
Reciprocity and the evolution of reputation
J. Theor. Biol.
Evolution of indirect reciprocity in groups of various sizes and comparison with direct reciprocity
J. Theor. Biol.
Three-person game facilitates indirect reciprocity under image scoring
J. Theor. Biol.
The importance of subjectivity in perceptual errors on the emergence of indirect reciprocity
J. Theor. Biol.
The long-term benefits of human generosity in indirect reciprocity
Curr. Biol.
How effective are on-line reputation mechanisms? An experimental investigation
Manage. Sci.
Image scoring and cooperation in a cleaner fish mutualism
Nature
When does “economic man” dominate social behaviour?
Science
Direct vs indirect reciprocation—an experiment
Homo Oeconomicus
Cited by (74)
Emotional game and the evolution of cooperation considering the effects of reputation
2022, Physica A: Statistical Mechanics and its ApplicationsThe evolution of morals under indirect reciprocity
2021, Games and Economic BehaviorIndirect reciprocity with optional games and monitoring of interactions between defectors
2019, Mathematical BiosciencesA solution for private assessment in indirect reciprocity using solitary observation
2018, Journal of Theoretical BiologyIndirect reciprocity with stochastic and dual reputation updates
2023, PLoS Computational Biology