Evolution of indirect reciprocity

Natural selection is conventionally assumed to favour the strong and selfish who maximize their own resources at the expense of others. But many biological systems, and especially human societies, are organized around altruistic, cooperative interactions. How can natural selection promote unselfish behaviour? Various mechanisms have been proposed, and a rich analysis of indirect reciprocity has recently emerged: I help you and somebody else helps me. The evolution of cooperation by indirect reciprocity leads to reputation building, morality judgement and complex social interactions with ever-increasing cognitive demands.     

Indirect reciprocity can stabilize cooperation without the second-order free rider problem

Models of large-scale human cooperation take two forms. 'Indirect reciprocity' occurs when individuals help others in order to uphold a reputation and so be included in future cooperation. In 'collective action', individuals engage in costly behaviour that benefits the group as a whole. Although the evolution of indirect reciprocity is theoretically plausible, there is no consensus about how collective action evolves. Evidence suggests that punishing free riders can maintain cooperation, but why individuals should engage in costly punishment is unclear. Solutions to this 'second-order free rider problem' include meta-punishment, mutation, conformism, signalling and group-selection. The threat of exclusion from indirect reciprocity can sustain collective action in the laboratory. Here, we show that such exclusion is evolutionarily stable, providing an incentive to engage in costly cooperation, while avoiding the second-order free rider problem because punishers can withhold help from free riders without damaging their reputations. However, we also show that such a strategy cannot invade a population in which indirect reciprocity is not linked to collective action, thus leaving unexplained how collective action arises.     

Behaviorial evolution: does similarity breed cooperation?

Reciprocity, whether direct or indirect, is thought to be the key to establishing cooperation among non-relatives. But Riolo et al. have presented a model in which cooperation is instead based on similarity: agents donate only when their partner's 'tag' lies within a 'tolerance' range around their own. Here we point out that their model requires individuals with identical tags to cooperate with each other, and show that cooperation tends to collapse when individuals bearing identical tags are given the option of not donating. We therefore question their mechanism for maintaining cooperation without reciprocity.     

合作进化模型综述

作者综述了合作进化模型的最新研究成果。合作进化模型以“囚徒困境”博弈模型为基础, 为合作中的个体提供了一种与个体本身无关的策略优化机制, 以此探讨合作策略能够稳定进化的条件。基于直接或间接互惠理论的合作进化模型验证了在小规模社会中建立声誉机制有助于实现稳定的互惠合作; 互惠可以看做是对合作行为的奖赏, 开放的社会网络有助于实现较大范围内的合作; 对非合作行为实施惩罚有助于实现多人合作, 在一定条件下, 由非合作者实施惩罚时的合作进化相较于由合作者实施时更稳定; 群组竞争有利于合作文化或制度的传播, 但无法解释群组融合后的合作问题。     

基于二阶声誉测度的自组织网络合作激励机制

将二阶声誉测度Standing应用到自组织网络的合作激励机制中,设计了一种基于Standing的包括服务和声誉管理的分布式合作管理协议,克服了间接互惠所面临的二阶搭便车问题.数学分析和模拟实验表明,在二阶声誉作用下,区分策略是演化博弈惟一的进化稳定策略,从而促进了用户的合作.同时,采用完全的分布方式所构建的可信第三方架构能够有效应对合谋、虚假的声誉反馈与声誉提供等欺骗行为.该合作机制在一般的动态环境中具有良好的适应性.     

Emergence of cooperation and evolutionary stability in finite populations

To explain the evolution of cooperation by natural selection has been a major goal of biologists since Darwin. Cooperators help others at a cost to themselves, while defectors receive the benefits of altruism without providing any help in return. The standard game dynamical formulation is the 'Prisoner's Dilemma', in which two players have a choice between cooperation and defection. In the repeated game, cooperators using direct reciprocity cannot be exploited by defectors, but it is unclear how such cooperators can arise in the first place. In general, defectors are stable against invasion by cooperators. This understanding is based on traditional concepts of evolutionary stability and dynamics in infinite populations. Here we study evolutionary game dynamics in finite populations. We show that a single cooperator using a strategy like 'tit-for-tat' can invade a population of defectors with a probability that corresponds to a net selective advantage. We specify the conditions required for natural selection to favour the emergence of cooperation and define evolutionary stability in finite populations.     

Human cooperation: second-order free-riding problem solved?

Panchanathan and Boyd describe a model of indirect reciprocity in which mutual aid among cooperators can promote large-scale human cooperation without succumbing to a second-order free-riding problem (whereby individuals receive but do not give aid). However, the model does not include second-order free riders as one of the possible behavioural types. Here I present a simplified version of their model to demonstrate how cooperation unravels if second-round defectors enter the population, and this shows that the free-riding problem remains unsolved.     

Reputation helps solve the 'tragedy of the commons'.

The problem of sustaining a public resource that everybody is free to overuse-the 'tragedy of the commons'-emerges in many social dilemmas, such as our inability to sustain the global climate. Public goods experiments, which are used to study this type of problem, usually confirm that the collective benefit will not be produced. Because individuals and countries often participate in several social games simultaneously, the interaction of these games may provide a sophisticated way by which to maintain the public resource. Indirect reciprocity, 'give and you shall receive', is built on reputation and can sustain a high level of cooperation, as shown by game theorists. Here we show, through alternating rounds of public goods and indirect reciprocity games, that the need to maintain reputation for indirect reciprocity maintains contributions to the public good at an unexpectedly high level. But if rounds of indirect reciprocation are not expected, then contributions to the public good drop quickly to zero. Alternating the games leads to higher profits for all players. As reputation may be a currency that is valid in many social games, our approach could be used to test social dilemmas for their solubility.     

Evolution and maintenance of cooperation via inheritance of neighborhood relationship

Cooperative behaviors are ubiquitous in nature and human society. It is very important to understand the internal mechanism of emergence and maintenance of cooperation. As we know now, the offsprings inherit not only the phenotype but also the neighborhood relationship of their parents. Some recent research results show that the interactions among individuals facilitate survival of cooperation through network reciprocity of clustering cooperators. This paper aims at introducing an inheritance mechanism of neighborhood relationship to explore the evolution of cooperation. In detail, a mathematical model is proposed to characterize the evolutionary process with the above inheritance mechanism. Theoretical analysis and numerical simulations indicate that high-level cooperation can emerge and be maintained for a wide variety of cost-to-benefit ratios, even if mutation happens during the evolving process.     

Emergence of group cooperation in public goods game on regular small-world network

The regular small-world network, which contains the properties of small-world network and regular network, has recently received substantial attention and has been applied in researches on 2-person games. However, it is a common phenomenon that cooperation always appears as a group behavior. In order to investigate the mechanism of group cooperation, we propose an evolutionary multi-person game model on a regular small-world network based on public goods game theory. Then, to make a comparison of frequency of cooperation among different networks, we carry out simulations on three kinds of networks with the same configuration of average degree: the square lattice, regular small-world network and random regular network. The results of simulation show that the group cooperation will emerge among these three networks when the enhancement factor r exceeds a threshold. Furthermore, time required for full cooperation on regular small-world network is slightly longer than the other networks, which indicates that the compact interactions and random interactions will promote cooperation, while the longer-range links are the obstacles in the emergence of cooperation. In addition, the cooperation would be promoted further by enhancing the random interactions on regular small-world network.     

Winners don't punish

A key aspect of human behaviour is cooperation. We tend to help others even if costs are involved. We are more likely to help when the costs are small and the benefits for the other person significant. Cooperation leads to a tension between what is best for the individual and what is best for the group. A group does better if everyone cooperates, but each individual is tempted to defect. Recently there has been much interest in exploring the effect of costly punishment on human cooperation. Costly punishment means paying a cost for another individual to incur a cost. It has been suggested that costly punishment promotes cooperation even in non-repeated games and without any possibility of reputation effects. But most of our interactions are repeated and reputation is always at stake. Thus, if costly punishment is important in promoting cooperation, it must do so in a repeated setting. We have performed experiments in which, in each round of a repeated game, people choose between cooperation, defection and costly punishment. In control experiments, people could only cooperate or defect. Here we show that the option of costly punishment increases the amount of cooperation but not the average payoff of the group. Furthermore, there is a strong negative correlation between total payoff and use of costly punishment. Those people who gain the highest total payoff tend not to use costly punishment: winners don't punish. This suggests that costly punishment behaviour is maladaptive in cooperation games and might have evolved for other reasons.     

Facultative cheater mutants reveal the genetic complexity of cooperation in social amoebae

Cooperation is central to many major transitions in evolution, including the emergence of eukaryotic cells, multicellularity and eusociality. Cooperation can be destroyed by the spread of cheater mutants that do not cooperate but gain the benefits of cooperation from others. However, cooperation can be preserved if cheaters are facultative, cheating others but cooperating among themselves. Several cheater mutants have been studied before, but no study has attempted a genome-scale investigation of the genetic opportunities for cheating. Here we describe such a screen in a social amoeba and show that cheating is multifaceted by revealing cheater mutations in well over 100 genes of diverse types. Many of these mutants cheat facultatively, producing more than their fair share of spores in chimaeras, but cooperating normally when clonal. These findings indicate that phenotypically stable cooperative systems may nevertheless harbour genetic conflicts. The opportunities for evolutionary moves and countermoves in such conflicts may select for the involvement of multiple pathways and numerous genes.     

Social networks and cooperation in hunter-gatherers

Social networks show striking structural regularities, and both theory and evidence suggest that networks may have facilitated the development of large-scale cooperation in humans. Here, we characterize the social networks of the Hadza, a population of hunter-gatherers in Tanzania. We show that Hadza networks have important properties also seen in modernized social networks, including a skewed degree distribution, degree assortativity, transitivity, reciprocity, geographic decay and homophily. We demonstrate that Hadza camps exhibit high between-group and low within-group variation in public goods game donations. Network ties are also more likely between people who give the same amount, and the similarity in cooperative behaviour extends up to two degrees of separation. Social distance appears to be as important as genetic relatedness and physical proximity in explaining assortativity in cooperation. Our results suggest that certain elements of social network structure may have been present at an early point in human history. Also, early humans may have formed ties with both kin and non-kin, based in part on their tendency to cooperate. Social networks may thus have contributed to the emergence of cooperation.     

考虑合作费用的企业合作网络模型

基于Jackson的连接模型,将合作费用加入到企业合作网络中,并引入议价能力来表示其大小。议价能力体现了合作企业间资源的差异程度。研究分析表明,议价能力的优势可以使企业通过收取合作费用来剥夺其他企业的合作收益;拥有强议价能力的企业可以采取适当的议价策略来吸引其他企业的合作,同时,第一个和它合作的企业要付出较高的合作费用,第二个合作企业付出最低的合作费用,之后费用逐渐递增。     

The coevolution of choosiness and cooperation

Explaining the rise and maintenance of cooperation is central to our understanding of biological systems and human societies. When an individual's cooperativeness is used by other individuals as a choice criterion, there can be competition to be more generous than others, a situation called competitive altruism. The evolution of cooperation between non-relatives can then be driven by a positive feedback between increasing levels of cooperativeness and choosiness. Here we use evolutionary simulations to show that, in a situation where individuals have the opportunity to engage in repeated pairwise interactions, the equilibrium degree of cooperativeness depends critically on the amount of behavioural variation that is being maintained in the population by processes such as mutation. Because our model does not invoke complex mechanisms such as negotiation behaviour, it can be applied to a wide range of species. The results suggest an important role of lifespan in the evolution of cooperation.     

Spatial structure often inhibits the evolution of cooperation in the snowdrift game

Understanding the emergence of cooperation is a fundamental problem in evolutionary biology. Evolutionary game theory has become a powerful framework with which to investigate this problem. Two simple games have attracted most attention in theoretical and experimental studies: the Prisoner's Dilemma and the snowdrift game (also known as the hawk-dove or chicken game). In the Prisoner's Dilemma, the non-cooperative state is evolutionarily stable, which has inspired numerous investigations of suitable extensions that enable cooperative behaviour to persist. In particular, on the basis of spatial extensions of the Prisoner's Dilemma, it is widely accepted that spatial structure promotes the evolution of cooperation. Here we show that no such general predictions can be made for the effects of spatial structure in the snowdrift game. In unstructured snowdrift games, intermediate levels of cooperation persist. Unexpectedly, spatial structure reduces the proportion of cooperators for a wide range of parameters. In particular, spatial structure eliminates cooperation if the cost-to-benefit ratio of cooperation is high. Our results caution against the common belief that spatial structure is necessarily beneficial for cooperative behaviour.     

Egalitarian motives in humans

Participants in laboratory games are often willing to alter others' incomes at a cost to themselves, and this behaviour has the effect of promoting cooperation. What motivates this action is unclear: punishment and reward aimed at promoting cooperation cannot be distinguished from attempts to produce equality. To understand costly taking and costly giving, we create an experimental game that isolates egalitarian motives. The results show that subjects reduce and augment others' incomes, at a personal cost, even when there is no cooperative behaviour to be reinforced. Furthermore, the size and frequency of income alterations are strongly influenced by inequality. Emotions towards top earners become increasingly negative as inequality increases, and those who express these emotions spend more to reduce above-average earners' incomes and to increase below-average earners' incomes. The results suggest that egalitarian motives affect income-altering behaviours, and may therefore be an important factor underlying the evolution of strong reciprocity and, hence, cooperation in humans.     

基于Markov对策和强化学习的多智能体协作研究

MAS的协作机制研究,当前比较适用的研究框架是非零和Markov对策及基于Q－算法的强化学习。但实际上在这种框架下的Agent强调独立学习而不考虑其他Agent的行为,故MAS缺乏协作机制。并且,Q－算法要求Agent与环境的交互时具有完备的观察信息,这种情况过于理想化。文中针对以上两个不足,提出了在联合行动和不完备信息下的协调学习。理论分析和仿真实验表明,协调学习算法具有收敛性。     

拓展训练改善大学生团队合作能力的实验研究

文章运用实验研究方法探讨其对改善大学生团队合作能力是否具有积极作用。研究结果显示,拓展训练在改善大学生团队合作能力方面具有正向积极作用,且实验前后团队合作能力三个维度因子,即团队凝聚力、信息共享以及互惠性等统计数据均具有显著性差异。     

Altruistic punishment in humans.

Human cooperation is an evolutionary puzzle. Unlike other creatures, people frequently cooperate with genetically unrelated strangers, often in large groups, with people they will never meet again, and when reputation gains are small or absent. These patterns of cooperation cannot be explained by the nepotistic motives associated with the evolutionary theory of kin selection and the selfish motives associated with signalling theory or the theory of reciprocal altruism. Here we show experimentally that the altruistic punishment of defectors is a key motive for the explanation of cooperation. Altruistic punishment means that individuals punish, although the punishment is costly for them and yields no material gain. We show that cooperation flourishes if altruistic punishment is possible, and breaks down if it is ruled out. The evidence indicates that negative emotions towards defectors are the proximate mechanism behind altruistic punishment. These results suggest that future study of the evolution of human cooperation should include a strong focus on explaining altruistic punishment.