Академический Документы
Профессиональный Документы
Культура Документы
Science, New Series, Vol. 211, No. 4489. (Mar. 27, 1981), pp. 1390-1396.
Stable URL:
http://links.jstor.org/sici?sici=0036-8075%2819810327%293%3A211%3A4489%3C1390%3ATEOC%3E2.0.CO%3B2-6
Your use of the JSTOR archive indicates your acceptance of JSTOR's Terms and Conditions of Use, available at
http://www.jstor.org/about/terms.html. JSTOR's Terms and Conditions of Use provides, in part, that unless you have obtained
prior permission, you may not download an entire issue of a journal or multiple copies of articles, and you may use content in
the JSTOR archive only for your personal, non-commercial use.
Please contact the publisher regarding any further use of this work. Publisher contact information may be obtained at
http://www.jstor.org/journals/aaas.html.
Each copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed
page of such transmission.
The JSTOR Archive is a trusted digital repository providing for long-term preservation and access to leading academic
journals and scholarly literature from around the world. The Archive is supported by libraries, scholarly societies, publishers,
and foundations. It is an initiative of JSTOR, a not-for-profit organization with a mission to help the scholarly community take
advantage of advances in technology. For more information regarding JSTOR, please contact support@jstor.org.
http://www.jstor.org
Fri Jan 4 15:02:00 2008
The latest data for 1978 suggests that the situa- ary 1975) the Committee on Science and Tech- budget appropriations." In other words, it
tion may, in fact, be deteriorating. . . . we may nology received jurisdiction over envlron- seems that work on highly relevant matters
be losing the war on air pollution." mental research" as a result of several changes might be funded even if of poor quality. [See
3. For examples see House Subcommittee on the in the rules of the House of Representatives. EPA and the Academic Community (EPA-60018-
Environment and the Atmosphere, The Erzviron- The Subcommittee on the Environment and the 80-010, Environmental Protection Agency, Cin-
mentcrl Protection Agerzcy's Resecrrch Progrcrm Atmosphere was formed to handle this juris- cinnati, Ohio, 19801, p. 2.1
with Prirnury F,'rnphusis on the Community diction and for 4 years (two Congresses), with 19. National Academy of Sciences, Materials Advi-
lfecrlth und Environmenrul Surveillance Syatem Congressman Brown as chairman, had respon- sory Board, Repor1 of the Ad Hoc C o m m i t t ~ eon
(CHESS):An lnveatigative Report (Government sibility for ORD. In January 1979, as a re- Principles i?fReseurch-Engineerinx Interuc'tion
Printing Office, Washington, D.C., 1976). espe- sult of reorganization within the Committee on (National Academy of Sciences, Washington,
cially chapters 4 to 6. Science and Technology, Congressman Brown D.C., 1966), p. 16.
4. Without trying to be entirely rigorous, we will moved to the chair of the Subcommittee on 20. W. 0 . Baker, in House Committee on Science
use an NSF definition: "Basic research is that Science, Research, and Technology. The Sub- and Technology, Serninur on Reaeurch, Produc-
type of research which is directed toward in- committee on the Environment and Atmosphere tivity, und the Natiorzul Economy, 18 Jrrne I980
crease of knowledge in science. It is research was renamed Subcommittee on Natural Re- (Government Printing Office, Washington,
where the primary aim of the investigator is a sources and Environment and given some addi- D.C., 1980).
fuller knowledge or understanding of the subject tional jurisdiction. 21. Testimony of J. N. Pitts, in 1980 Aulhorizcltion
under study, rather than a practical application 13. Eni~ironmrnterlProtection Agency Reseurch und ,for the Office o f Resecrrch und Developnzenl,
thereof." This was given by A. T. Waterman, Development laarres: 1978, hearings before the Eni~ironmrntulProtection Ayency, hearings be-
then director of NSF, in Symposium on Ruaic House Subcommittee on the Environment and fore the House Subcommittee on Science and
Reaeurch, D. Wolfle, Ed. (American Associ- the Atmosphere, 19 July and 13 and 14 Septem- Technology, 13 and 15 February 1979 (Govern-
ation for the Advancement of Science, Washing- ber 1978 (Government Printing Office, Washing- ment Printing Office, Washington, D.C., 1979).
ton, D.C., 1959). p. 20. ton, D.C., 1979). 22. H. W. Bode, in nusic Resecrrch und Nrrtioncrl
5. For example, the EPA administrator, D. Costle, 14. In making funding decisions, the agency uses a Gorrls, a report to the House Committee on
in a letter dated 12 June 1978 to Senator William zero-base budgeting (ZBB) process in which Science and Astronautics (National Academy of
Proxmire, chairman of the HUD-lndependent programs are approved by a~consensusof the Sciences, Washington, D.C., 1965), p. 74.
Agencies Subcommittee of the Senate Appropri- administrator and the six assistant administra- 23. At present the program offices guide EPA's
atrons Committee, said concerning enviionmen- tors. In the ZBB process, the ORD has only research not only through the ZBB process but
tal research, "I've had to make too many billion about one of six votes, and thus research pro- also through the mechanism of 13 research com-
dollar decisions over the last year without the grams are vulnerable to a great deal of influence mittees. These committees translate program
critical information this sort of investment, from the program offices. Because they play ofice needs into "research strategy docu-
made five years ago, would have provided." such a substantial role in defining the program of ments" which guide all EPA research (10).
6. U.S. Congress, Office of Technology Assess- research ultimately conducted by ORD, the 24. This provision is contained in section 6 of Public
ment, A Review i f the U . S . F,'nvironmrntul administrator and all assistant administrators Law 95-155, the FY 1978 authorization act for
Protection Agency Environmentcrl Resecrrch were asked to testify on what they expect from ORD. For explanation of congressional intent
Outlook FY I976 through 1980 (Government that office. see Conference Report to Accompcrny H.R.
Printing Office, Washington, D.C., 1976). 15. Speciul Urban Air Pollution Problema: Denver 5101, 95th Congress, Report No. 95-722 (Gov-
7. National Academy of Sciences, Commission on und Houaton, hearings before the House Sub- ernment Printing Office, Washington, D.C.,
Natural Resources, Ar~ul),ticcrlStudies for the committee on the Environment and the Atmo- 1977).
. ,.
U . S . Environmentul Protection Agency, vol. 3, sphere, 19 and 21 November 1977 (Government 25. This provision is contained in section 11 of
Research and Development in the Environmen- Printing Office, Washington, D.C., 1978). Public Law 95-155. For explanation see the
tul Protection Agency (National Academy of 16. Long-Term Environmental Research in the En- report cited in (10), and also Report lo Acc'om-
Sciences, Washington, D.C., 1977). i~ironmenterlProtection Agency, hearings before puny H . R . 5101, 95th Congress, Report No. 95-
8. National Advisory Committee on Oceans and the House Subcommittee on the Environment 157 (Government Printing Office, Washington,
Atmosphere, A Report lo the President crnd the and the Atmosphere, 30 June 1977 (Government D.C.. 1977).
Congress, fifth annual report (Government Printing Office, Washington, D.C., 1978). See 26. This was cbntained in section 4(a) of H.R. 7099,
Printing Ofice, Washington, D.C., 1976). the testimony of R. L . Sansom, especially his the House version of the FY 1981 authorization
9. ORD Progrcrm Guide (EPA-60019-79-038, Envi- supplemental statement, p. 52. bill. The provision was deleted from the final
ronmental Protection Agency, Washington, 17. H. Kissinger, The Reporter, 5 March 1959, p. version of the bill at least in part because the
D.C.. 1979). -10.~ agency strenuously (if informally) opposed it
10. Kesecrrch ~ r r t l o o k 1980
, (EPA-60019-80-006, En- 18. For example, the agency has instituted a new and succeeded in having it removed from the
vironmental Protection Agency, Washington, system of research grants putatively aimed at Senate-passed version of the bill. For cxplana-
D.C., 1980). This presents the agency's 5-year bringing new work of high quality into its pro- tion of intent, see Report to Accompan)~H . K .
environmental research plan in response to stat- gram. Despite this aim the published solicitation 7099, 96th Congress, Report No. 96-959 (Gov-
utory requirement. The plan is updated and a for grant proposals does not explicitly and ernment Printing Office, Washington, D.C.,
new report issued annually. unambiguously state that funding decisions will 1980).
11. Many examples of the environmental problems be based on scientific quality. Instead the fol- 27. J. Bronowski, The Common Senae of Science
EPA faces are reported in Environmentcrl Oul- lowing appears: "Scientific merit and relevance (Harvard Univ. Press, Cambridge, Mass., 19781,
look 1980 (EPA 60018-80-003, Environmental of proposals will be significant and balanced p. 143.
Protection Agency, Washington, D.C., 1980). factors in the evaluation procedures since all 28. We thank A. V. Applegate for substantial assist-
12. At the beginning of the 94th Congress (Janu- projects must be in concert with the Agency's ance in the preparation of this paper.
1390 0036-807518110327-1390$01 .SO10 Copyright O 1981 AAAS SCIENCE, VOL. 21 1, 27 MARCH 1981
truism can benefit reproduction of the ing-or a larger part of the behavior is Prisoner's Dilemma game in particular,
set, despite losses to the individual altru- attributable to stable reciprocity. Pre- allow a formalization of the strategic
ist. In accord with this theory's predic- vious accounts that already invoke reci- possibilities inherent in such situations.
tions, apart from the human species, procity, however, underemphasize the The Prisoner's Dilemma game is an
almost all clear cases of altruism, and stringency of its conditions (15). elegant embodiment of the problem of
most observed cooperation, occur in Our contribution in this area is new in achieving mutual cooperation (16), and
contexts of high relatedness, usually be- three ways. therefore provides the basis for our anal-
tween immediate family members. The 1) In a biological context, our model is ysis. To keep the analysis tractable, we
evolution of the suicidal barbed sting of novel in its probabilistic treatment of the focus on the two-player version of the
the honeybee worker could be taken as possibility that two individuals may in- game, which describes situations that
paradigm for this line of theory (7). teract again. This allows us to shed new involve interactions between pairs of
Conspicuous examples of cooperation
(although almost never of ultimate self-
sacrifice) also occur where relatedness is Summary. Cooperation in organisms, whether bacteria or primates, has been a
low or absent. Mutualistic symbioses difficulty for evolutionary theory since Darwin. On the assumption that interactions
offer striking examples such as these: the between pairs of individuals occur on a probabilistic basis, a model is developed
fungus and alga that compose a lichen; based on the concept of an evolutionarily stable strategy in the context of the
the ants and ant-acacias, where the trees Prisoner's Dilemma game. Deductions from the model, and the results of a computer
house and feed the ants which, in turn, tournament show how cooperation based on reciprocity can get started in an asocial
protect the trees (8); and the fig wasps world, can thrive while interacting with a wide range of other strategies, and can resist
and fig tree, where wasps, which are invasion once fully established. Potential applications include specific aspects of
obligate parasites of fig flowers, serve as territoriality, mating, and disease.
the tree's sole means of pollination and
seed set ( 9 ) . Usually the course of coop-
eration in such symbioses is smooth, but light on certain specific biological pro- individuals. In the Prisoner's Dilemma
sometimes the partners show signs of cesses such as aging and territoriality. game, two individuals can each either
antagonism, either spontaneous or elicit- 2) Our analysis of the evolution of cooperate or defect. The payoff to a
ed by particular treatments (10). Al- cooperation considers not just the final player is in terms of the effect on its
though kinship may be involved, as will stability of a given strategy, but also the fitness (survival and fecundity). No mat-
be discussed later, symbioses mainly il- initial viability of a strategy in an envi- ter what the other does, the selfish
lustrate the other recent extension of ronment dominated by noncooperating choice of defection yields a higher payoff
evolutionary theory, the theory of recip- individuals, as well as the robustness of a than cooperation. But if both defect,
rocation. strategy in a variegated environment both do worse than if both had cooperat-
Cooperation per se has received com- composed of other individuals using a ed.
paratively little attention from biologists variety of more or less sophisticated Figure 1 shows the payoff matrix of
since the pioneer account of Trivers (5); strategies. This allows a richer under- the Prisoner's Dilemma. If the other
but an associated issue, concerning re- standing of the full chronology of the player cooperates, there is a choice be-
straint in conflict situations, has been evolution of cooperation than has pre- tween cooperation which yields R (the
developed theoretically. In this connec- viously been possible. reward for mutual cooperation) or defec-
tion, a new concept, that of an evolution- 3) Our applications include behavioral tion which yields T (the temptation to
arily stable strategy, has been formally interaction at the microbial level. This aefect). By assumption, T > K ,so that it
developed (6, 11). Cooperation in the leads us to some speculative suggestions pays to defect if the other player cooper-
more normal sense has remained cloud- of rationales able to account for the ates. On the other hand, if the other
ed by certain difficulties, particularly existence of both chronic and acute player defects, there is a choice between
those concerning initiation of cooper- phases in many diseases, and for a cer- cooperation which yields S (the sucker's
ation from a previously asocial state (12) tain class of chromosomal nondisjunc- payof) or defection which yields P (the
and its stable maintenance once estab- tion, exemplified by Down's syndrome. punishment for mutual defection). By
lished. A formal theory of cooperation is assumption P > S , so it pays to defect if
increasingly needed. The renewed em- the other player defects. Thus, no matter
phasis on individualism has focused on Strategies in the Prisoner's Dilemma what the other player does, it pays to
the frequent ease of cheating in recipro- defect. But, if both defect, both get P
catory arrangements. This makes the Many of the benefits sought by living rather than the larger value of R that they
stability of even mutualistic symbioses things are disproportionally available to both could have gotten had both cooper-
appear more questionable than under the cooperating groups. While there are con- ated. Hence the dilemma (17).
old view of adaptation for species bene- siderable differences in what is meant by With two individuals destined never to
fit. At the same time other cases that the terms "benefits" and "sought," this meet again, the only strategy that can be
once appeared firmly in the domain of statement, insofar as it is true, lays down called a solution to the game is to defect
kinship theory now begin to reveal rela- a fundamental basis for all social life. always despite the seemingly paradox-
tednesses of interactants that are too low The problem is that while an individual ical outcome that both do worse than
for much nepotistic altruism to be ex- can benefit from mutual cooperation, they could have had they cooperated.
pected. This applies both to cooperative each one can also do even better by Apart from being the solution in game
breeding in birds (13) and to cooperative exploiting the cooperative efforts of oth- theory, defection is also the solution in
acts more generally in primate groups ers. Over a period of time, the same biological evolution (18). It is the out-
(14). Here either the appearances of co- individuals may interact again, allowing come of inevitable evolutionary trends
operation are deceptive-they are cases for complex patterns of strategic interac- through mutation and natural selection:
of part-kin altruism and part cheat- tions. Game theory in general, and the if the payofs are in terms of fitness, and
27 MARCH 1981
Player B tive to others. A bacterium might easily
C
D
have production of its own bacteriocin
Cooperation
Defection
dependent on the perceived presence of
play"* I R=3
Reward for
1
7
I
I
Fig. 1. The Prisoner's Dilem-
ma game. The payoff to player
like hostile products in its environment,
but it could not aim the toxin produced
C
Cooperation
mutual cooperation
1 Sucker's payoff
1'
A is with
numerical values. The game is
toward an offending initiator. From ex-
isting evidence, so far from an individual
C--------------i---------------+ defined by T > R > P > S
! T=5 I P=l 1 and R > (S + T)/2. level, discrimination seems to be by spe-
D
' Temptation to / Punishment for 1 cies rather even than variety. For exam-
Defection
i defect 1 mutual defection I ple, a Rhizobium strain may occur in
nodules which it causes on the roots of
many species of leguminous plants, but it
may fix nitrogen for the benefit of the
plant in only a few of these species (20).
the interactions between pairs of individ- individuals will meet again. Factors that Thus, in many legumes the Khizohium
uals are random and not repeated, then affect the magnitude of this probability of seems to be a pure parasite. In the light
any population with a mixture of herita- meeting again include the average life- of theory to follow, it would be interest-
ble strategies evolves to a state where all span, relative mobility, and health of the ing to know whether these parasitized
individuals are defectors. Moreover, no individuals. For any value of w, the legumes are perhaps less beneficial to
single differing mutant strategy can do strategy of unconditional defection free living Khizohirnm in the surrounding
better than others when the population is (ALL D) is evolutionarily stable; if ev- soil than are those in which the full
using this strategy. In these respects the eryone is using this strategy, no mutant symbiosis is established. But the main
strategy of defection is stable. strategy can invade the population. But point of concern here is that such dis-
This concept of stability is essential to other strategies may be evolutionarily crimination by a Rhizobium seems not to
the discussion of what follows and it is stable as well. In fact, when w is suffi- be known even at the level of varieties
useful to state it more formally. A strate- ciently great, there is no single best within a species.
gy is evolutionarily stable if a population strategy regardless of the behavior of the As one moves up the evolutionary
of individuals using that strategy cannot others in the population (19). Just be- ladder in neural complexity, game-play-
be invaded by a rare mutant adopting a cause there is no single best strategy, it ing behavior becomes richer. The intelli-
different strategy (11). In the case of the does not follow that analysis is hopeless. gence of primates, including humans,
Prisoner's Dilemma played only once, On the contrary, we demonstrate not allows a number of relevant improve-
no strategy can invade the strategy of only the stability of a given strategy, but ments: a more complex memory, more
pure defection. This is because no other also its robustness and initial viability. complex processing of information to
strategy can do better with the defecting Before turning to the development of determine the next action as a function
individuals than the P achieved by the the theory, let us consider the range of of the interaction so far, a better estimate
defecting players who interact with each biological reality that is encompassed by of the probability of future interaction
other. So in the single-shot Prisoner's the game theoretic approach. To start with the same individual, and a better
Dilemma, to defect always is an evolu- with, an organism does not need a brain ability to distinguish between different
tionarily stable strategy. to employ a strategy. Bacteria, for exam- individuals. The discrimination of others
In many biological settings, the same ple, have a basic capacity to play games may be among the most important of
two individuals may meet more than in that (i) bacteria are highly responsive abilities because it allows one to handle
once. If an individual can recognize a to selected aspects of their environment, interactions with many individuals with-
previous interactant and remember some especially their chemical environment; out having to treat them all the same,
aspects of the prior outcomes, then the (ii) this implies that they can respond thus making possible the rewarding of
strategic situation becomes an iterated differentially to what other organisms cooperation from one individual and the
Prisoner's Dilemma with a much richer around them are doing; (iii) these condi- punishing of defection from another.
set of possibilities. A strategy would take tional strategies of behavior can certain- The model of the iterated Prisoner's
the form of a decision rule which deter- ly be inherited; and (iv) the behavior of a Dilemma is much less restricted than it
mined the probability of cooperation or bacterium can affect the fitness of other may at first appear. Not only can it apply
defection as a function of the history of organisms around it, just as the behavior to interactions between two bacteria or
the interaction so far. But if there is a of other organisms can affect the fitness interactions between two primates, but it
known number of interactions between a of a bacterium. can also apply to the interactions be-
pair of individuals, to defect always is While the strategies can easily include tween a colony of bacteria and, say, a
still evolutionarily stable and is still the differential responsiveness to recent primate serving as a host. There is no
only strategy which is. The reason is that changes in the environment or to cumu- assumption of commensurability of
defection on the last interaction would lative averages over time, in other ways payoffs between the two sides. Provided
be optimal for both sides, and conse- their range of responsiveness is limited. that the payoffs to each side satisfy the
quently so would defection on the next- Bacteria cannot "remember" or "inter- inequalities that define the Prisoner's
to-last interaction, and so on back to the pret" a complex past sequence of Dilemma (Fig. l), the results of the anal-
first interaction. changes, and they probably cannot dis- ysis will be applicable.
Our model is based on the more realis- tinguish alternative origins of adverse or The model does assume that the
tic assumption that the number of inter- beneficial changes. Some bacteria, for choices are made simultaneously and
actions is not fixed in advance. Instead, example, produce their own antibiotics, with discrete time intervals. For most
there is some probability, w, that after bacteriocins; those are harmless to bac- analytic purposes, this is equivalent to a
the current interaction the same two teria of the producing strain, but destruc- continuous interactiun over time, with
SCIENCE, VOL. 21 1
the time period of the model correspond- winner of the first round, Professor Ana- begins with C, the second round has the
ing to the minimum time between a to1 Rapoport of the Institute for Ad- same state as the first, and thus a maxi-
change in behavior by one side and a vanced Study (Vienna). It won again. An mal rule will continue with C and hence
response by the other. And while the analysis of the 3 million choices which always cooperate with TIT FOR TAT.
model treats the choices as simulta- were made in the second round identified But such a rule will not do better than
neous, it would make little difference if the impressive robustness of TIT FOR TIT FOK TAT does with another TIT
they were treated as sequential (21). TAT as dependent on three features: it FOR TAT, and hence it cannot invade.
Turning to the development of the was never the first to defect, it was If, on the other hand, a rule begins with
theory, the evolution of cooperation can provocable into retaliation by a defection D, then this first D induces a switch in
be conceptualized in terms of three sepa- of the other, and it was forgiving after the state of TIT FOR TAT and there are
rate questions: just one act of retaliation (24). two possibilities for continuation that
I) Robustness. What type of strategy The robustness of TIT FOR TAT was could be maximal. If D follows the first
can thrive in a variegated environment also manifest in an ecological analysis of D, then this being maximal at the start
composed of others using a wide variety a whole series of future tournaments. implies that it is everywhere maximal to
of more or less sophisticated strategies'? The ecological approach takes as given follow D with D, making the strategy
2) Stability. Under what conditions the varieties which are present and in- equivalent to ALL D. If C follows the
can such a strategy, once fully estab- vestigates how they do over time when initial D, the game is then reset as for the
lished, resist invasion by mutant strate- interacting with each other. This analysis first move; so it must be maximal to
gies'? was based on what would happen if each repeat the sequence of DC indefinitely.
3) Initial viability. Even if a strategy is of the strategies in the second round These points show that the task of
robust and stable, how can it ever get a were submitted to a hypothetical next searching a seemingly infinite array of
foothold in an environment which is pre- round in proportion to its success in the rules of behavior for one potentially
dominantly noncooperative? previous round. The process was then capable of invading TIT FOR TAT is
repeated to generate the time path of the really easier than it seemed: if neither
distribution of strategies. The results ALL D nor alternation of D and C can
Robustness showed that, as the less successful rules invade TIT FOR TAT, then no strategy
were displaced, TIT FOR TAT contin- can.
To see what type of strategy can thrive ued to do well with the rules which To see when these strategies can in-
in a variegated environment of more or initially scored near the top. In the long vade, we note that the probability that
less sophisticated strategies, one of us run, TIT FOR TAT displaced all the the nlh interaction actually occurs is
(R.A.) conducted a computer tourna- other rules and went to fixation (24). wn- l
. Therefore, the expression for the
ment for the Prisoner's Dilemma. The This provides further evidence that TIT total payoff is easily found by applying
strategies were submitted by game theo- FOR TAT'S cooperation based on reci- the weights 1, w, w2 . . . to the payoff
rists in economics, sociology, political procity is a robust strategy that can sequence and summing the resultant se-
science, and mathematics (22). The rules thrive in a variegated environment. ries. When TIT FOR TAT plays another
implied the payoff matrix shown in Fig. I TIT FOR TAT, it gets a payoff of R each
and a game length of 200 moves. The 14 move for a total of R + wR + W*R
entries and a totally random strategy Stability . . . , which is Rl(1 - w). ALL D play-
were paired with each other in a round ing with TIT FOR TAT gets Ton the first
robin tournament. Some of the strategies Once a strategy has gone to fixation, move and P thereafter, so it cannot in-
were quite intricate. An example is one the question of evolutionary stability vade TIT FOR TAT if
which on each move models the behav- deals with whether it can resist invasion
ior of the other player as a Markov by a mutant strategy. In fact, we will
process, and then uses Bayesian infer- now show that once TIT FOR TAT is Similarly when alternation of D and C
ence to select what seems the best established, it can resist invasion by any plays TIT FOR TAT, it gets a payoff of
choice for the long run. However, the possible mutant strategy provided that
result of the tournament was that the the individuals who interact have a suffi-
highest average score was attained by ciently large probability, w, of meeting
the simplest of all strategies submitted: again. The proof is described in the next Alternation of D and C thus cannot in-
TIT FOR TAT. This strategy is simply two paragraphs. vade TIT FOR TAT if
one of cooperating on the first move and As a first step in the proof we note that
then doing whatever the other player did since TIT FOR TAT "remembers" only
on the preceding move. Thus TIT FOR one move back, one C by the other Hence, with reference to the magnitude
TAT is a strategy of cooperation based player in any round is sufficient to reset of w, we find that neither of these two
on reciprocity. the situation as it was at the beginning of strategies (and hence no strategy at all)
The results of the first round were then the game. Likewise, one D sets the situa- can invade TIT FOR TAT if and only if
circulated and entries for a second round tion to what it was at the second round both
were solicited. This time there were 62 after a D was played in the first. Since
w 2 (T - R)I(T - P) and
entries from six countries (23). Most of there is a fixed chance, w, of the interac-
w 2 (T - R)I(R - S) (1)
the contestants were computer hob- tion not ending at any given move, a
byists, but there were also professors of strategy cannot be maximal in playing This demonstrates that TIT FOR TAT is
evolutionary biology, physics, and com- with TIT FOR TAT unless it does the evolutionarily stable if and only if the
puter science, as well as the five disci- same thing both at the first occurrence of interactions between the individuals
plines represented in the first round. TIT a given state and at each resetting to that have a sufficiently large probability of
FOR TAT was again submitted by the state. Thus, if a rule is maximal and continuing (19).
27 MARCH 1981
Initial Viability cooperation based on reciprocity can strategy like 'SIT FOR TAT became es-
thrive and be evolutionarily stable in a tablished itself. Actually, there is an in-
TIT FOR TAT is not the only strategy population with no relatedness at all. teresting asymmetry here. Let us define
that can be evolutionarily stable. In fact, A case of cooperation that fits this a nice strategy as one, such as TIT FOR
ALL D is evolutionarily stable no matter scenario, at least on first evidence, has TAS, which will never be the first to
what is the probability of interaction been discovered in the spawning rela- defect. Obviously, when two nice strate-
continuing. This raises the problem of tionships in a sea bass (28). The fish, gies interact, they both receive R each
how an evolutionary trend to coopera- which are hermaphroditic, form pairs move, which is the highest average score
tive behavior could ever have started in and roughly may be said to take turns at an individual can get when interacting
the first place. being the high investment partner (laying with another individual using the same
Genetic kinship theory suggests a eggs) and low investment partner (pro- strategy. Therefore, if a strategy is nice
plausible escape from the equilibrium of viding sperm to fertilize eggs). Up to ten and is evolutionarily stable, it cannot be
ALL D. Close relatedness of interac- spawnings occur in a day and only a few intruded upon by a cluster. This is be-
tants permits true altruism-sacrifice of eggs are provided each time. Pairs tend cause the score achieved by the strategy
fitness by one individual for the benefit to break up if sex roles are not divided that comes in a cluster is a weighted
of another. True altruism can evolve evenly. The system appears to allow the average of how it does with others of its
when the conditions of cost, benefit, and evolution of much economy in the size of kind and with the predominant strategy.
relatedness yield net gains for the altru- testes, but Fischer (28) has suggested Each of these components is less than or
ism-causing genes that are resident in the that the testis condition may have equal to the score achieved by the pre-
related individuals (25). Not defecting in evolved when the species was more dominant, nice, evolutionarily stable
a single-move Prisoner's Dilemma is al- sparse and inclined to inbreed. Inbreed- strategy, and therefore the strategy ar-
truism of a kind (the individual is forego- ing would imply relatedness in the pairs riving in a cluster cannot intrude on the
ing proceeds that might have been taken) and this initially may have transferred nice. evolutionarily stable strategy (19).
and so can evolve if the two interactants the system to attractance of tit-for-tat This means that when w is large enough
are sufficiently related (18). In effect, cooperation-that is, to cooperation un- to make TIT FOR TAT an evolutionarily
recalculation of the payoff matrix in such needful of relatedness. stable strategy it can resist intrusion by
a way that an individual has a part inter- Another mechanism that can get coop- any cluster of any other strategy. The
est in the partner's gain (that is, reckon- eration started when virtually everyone gear wheels of social evolution have a
ing payoffs in terms of inclusive fitness) is using ALL D is clustering. Suppose ratchet.
can often eliminate the inequalities that a small group of individuals is using The chronological story that emerges
7' > R and P > S, in which case cooper- a strategy such as TIT FOR TAT and from this analysis is the following. ALL
ation becomes unconditionally favored that a certain proportion, p , of the inter- D is the primeval state and is evolution-
(18, 26). Thus it is possible to imagine actions of members of this cluster are arily stable. This means that it can resist
that the benefits of cooperation in Pris- with other members of the cluster. Then the invasion of any strategy that has
oner's Dilemma-like situations can begin the average score attained by the mem- virtually all of its interactions with ALL
to be harvested by groups of closely bers of the cluster in playing the 'TIT D. But cooperation based on reciprocity
related individuals. Obviously, as re- FOR TAT strategy is can gain a foothold through two different
gards pairs, a parent and its off'spring or a mechanisms. First, there can be kinship
plR!(l - w)l +
LINKED CITATIONS
- Page 1 of 3 -
This article references the following linked citations. If you are trying to access articles from an
off-campus location, you may be required to first logon via your library web site to access JSTOR. Please
visit your library's website or contact a librarian to learn about options for remote access to JSTOR.
4
The Evolution of Reciprocal Altruism
Robert L. Trivers
The Quarterly Review of Biology, Vol. 46, No. 1. (Mar., 1971), pp. 35-57.
Stable URL:
http://links.jstor.org/sici?sici=0033-5770%28197103%2946%3A1%3C35%3ATEORA%3E2.0.CO%3B2-S
5
Cooperative and Noncooperative Behavior in Animals
Ivan D. Chase
The American Naturalist, Vol. 115, No. 6. (Jun., 1980), pp. 827-857.
Stable URL:
http://links.jstor.org/sici?sici=0003-0147%28198006%29115%3A6%3C827%3ACANBIA%3E2.0.CO%3B2-Z
7
Altruism and Related Phenomena, Mainly in Social Insects
W. D. Hamilton
Annual Review of Ecology and Systematics, Vol. 3. (1972), pp. 193-232.
Stable URL:
http://links.jstor.org/sici?sici=0066-4162%281972%293%3C193%3AAARPMI%3E2.0.CO%3B2-V
8
Coevolution of Mutualism Between Ants and Acacias in Central America
Daniel H. Janzen
Evolution, Vol. 20, No. 3. (Sep., 1966), pp. 249-275.
Stable URL:
http://links.jstor.org/sici?sici=0014-3820%28196609%2920%3A3%3C249%3ACOMBAA%3E2.0.CO%3B2-%23
NOTE: The reference numbering from the original has been maintained in this citation list.
http://www.jstor.org
LINKED CITATIONS
- Page 2 of 3 -
9
How to be a Fig
Daniel H. Janzen
Annual Review of Ecology and Systematics, Vol. 10. (1979), pp. 13-51.
Stable URL:
http://links.jstor.org/sici?sici=0066-4162%281979%2910%3C13%3AHTBAF%3E2.0.CO%3B2-K
10
Altruism and Related Phenomena, Mainly in Social Insects
W. D. Hamilton
Annual Review of Ecology and Systematics, Vol. 3. (1972), pp. 193-232.
Stable URL:
http://links.jstor.org/sici?sici=0066-4162%281972%293%3C193%3AAARPMI%3E2.0.CO%3B2-V
18
Cooperative and Noncooperative Behavior in Animals
Ivan D. Chase
The American Naturalist, Vol. 115, No. 6. (Jun., 1980), pp. 827-857.
Stable URL:
http://links.jstor.org/sici?sici=0003-0147%28198006%29115%3A6%3C827%3ACANBIA%3E2.0.CO%3B2-Z
25
The Evolution of Altruistic Behavior
W. D. Hamilton
The American Naturalist, Vol. 97, No. 896. (Sep. - Oct., 1963), pp. 354-356.
Stable URL:
http://links.jstor.org/sici?sici=0003-0147%28196309%2F10%2997%3A896%3C354%3ATEOAB%3E2.0.CO%3B2-8
27
The Evolution of Social Behavior
Richard D. Alexander
Annual Review of Ecology and Systematics, Vol. 5. (1974), pp. 325-383.
Stable URL:
http://links.jstor.org/sici?sici=0066-4162%281974%295%3C325%3ATEOSB%3E2.0.CO%3B2-D
28
How Does Selection Reconcile Individual Advantage with the Good of the Group?
Egbert G. Leigh
Proceedings of the National Academy of Sciences of the United States of America, Vol. 74, No. 10.
(Oct., 1977), pp. 4542-4546.
Stable URL:
http://links.jstor.org/sici?sici=0027-8424%28197710%2974%3A10%3C4542%3AHDSRIA%3E2.0.CO%3B2-9
NOTE: The reference numbering from the original has been maintained in this citation list.
http://www.jstor.org
LINKED CITATIONS
- Page 3 of 3 -
29
The Market for "Lemons": Quality Uncertainty and the Market Mechanism
George A. Akerlof
The Quarterly Journal of Economics, Vol. 84, No. 3. (Aug., 1970), pp. 488-500.
Stable URL:
http://links.jstor.org/sici?sici=0033-5533%28197008%2984%3A3%3C488%3ATMF%22QU%3E2.0.CO%3B2-6
NOTE: The reference numbering from the original has been maintained in this citation list.