Next: Bibliography

© 2005 The American Physical Society

# Phase Transitions in Multiplicative Competitive Processes

Hideaki Shimazaki

Department of Physics, Graduate School of Science, Kyoto University, Kyoto 606-8502, Japan

Ernst Niebur

Department of Neuroscience, Zanvyl Krieger Mind/Brain Institute, School of Medicine, Johns Hopkins University, Baltimore, Maryland 21218

### Abstract:

We introduce a discrete multiplicative process as a generic model of competition. Players with different abilities successively join the game and compete for finite resources. Emergence of dominant players and evolutionary development occur as a phase transition. The competitive dynamics underlying this transition is understood from a formal analogy to statistical mechanics. The theory is applicable to bacterial competition, predicting novel population dynamics near criticality.

Competition occurs when two or more players such as organisms, individuals or companies strive for common but limited resources. It plays a significant role in biological and social activities, and is the basis of evolution. Most natural competition processes allow the introduction of new players, which is a hallmark of an open, nonequilibrium system. In this contribution, we introduce an irreversible discrete multiplicative process with normalization at each time step as a generic model of competition. Players with different abilities successively join the game and compete for finite resources. The model shows macroscopically observable changes in its behavior; at a singularity in the statistical distribution of the players' abilities, certain players become dominant over all others. The emergence of dominant players and the evolutionary development of the system occur as a transition from stationary to nonstationary state of the multiplicative process. We analyze the phase transition in the mathematical framework of Bose-Einstein condensation (BEC), although, of course, systems modelled are classical and not quantum mechanical. The same approach has been applied successfully to models of complex networks [Bianconi and Barabasi(2001)] and ecosystems [Volkov et al.(2004)Volkov, Banavar, and Maritan] that behave analogously to a Bose gas. We show that this approach is applicable to bacterial competition, providing surprising insights and predictions to their dynamics.

Before we present the model, we first introduce a general framework for how our multiplicative competition model is related to a statistical mechanics concept. Let be a function that satisfies the following conditions for an arbitrary density function defined on ,

 (1) (2) (3)

All terms on the right hand sides of these equations and in Eq. 3 are positive constants. Then is given by
 (4)

where . For, dividing Eq. 2 by , then subtracting Eq. 1 yields
 (5)

where . Multiplying Eq. 3 with and subtracting Eq. 5 from the result, the fundamental lemma of the calculus of variation then yields Eq. 4. Hence, the so-called occupation number in Eq. 5,
 (6)

becomes the Bose distribution. From Eq. 4, such a function may be obtained from the sum of a geometric progression with ratio . This motivates the analysis of the following multiplicative process.

The competition we introduce is defined by three conditions at each time step. (i) Players compete for a fixed total amount of resources. (ii) The resource gained by a player is proportional to the player's innate ability and to its resource gained at the previous time step. (iii) New players join the game, each with the same initial resources. The only exception is the first player (pioneer), who starts the game with all the resources available. These rules are summarized in a simple multiplicative process,

 (7)

where is the gain of the th player at time and is its ability, a positive and time-independent random variable chosen from a distribution . The term is a normalization factor, which models the limited resources. For simplicity, we first assume that , the number of newly introduced players at every time step, is 1. This means we consider simultaneous equations at time . The normalization factor is then defined by , where is given by
 (8)

This assures that the amount of resources distributed among players at time is for . The initial value of a new player is , except for the pioneer whose initial value is . Therefore, the total resources distributed among all players are limited to at every time step. Due to the normalization, we let , where , without loss of generality.

We now consider the time evolution of players except for the pioneer. The gain of the th player at time is given by , where

 (9)

The dynamics given by shows distinct phases determined by the shape of the ability distribution. To see this, we parameterize by the inverse temperature through . The random variable is chosen from , a state density function which now defines the system. We now systematically change by fixing and changing . If is a monotonically increasing function, which we will assume, high temperatures mean that the distribution of the players' abilities is restricted to a small range, i.e. all players have relatively similar abilities, while low temperature is synonymous with occasional appearance of superior players relative to others. From Eq. 9, we have
 (10)

using . By assuming stationarity of , discussed below, we let its time average be
 (11)

where is a time-independent constant. From Eq. 10 and Eq. 11, we obtain . Given , the cumulative gain , converges to in Eq. 4. Hence, the normalization of by the initial value , , approaches the Bose distribution in the thermodynamic limit . Indeed, in this limit,
 (12)

where . As the assumption of stationarity yields , we have from Eq. 11. By substituting this into Eq. 12, we obtain a self-consistent equation,
 (13)

where . Note that we can generalize Eq. 7 such that we allow new players to join the competition with initial value at each step. From a similar argument, we obtain Eq. 13, where . Thus the deduced form Eq. 13 of the competition under stationarity assumption shows a formal analogy to those obtained for a quantum gas. The normalization factor plays the role of keeping the total resources gained by all players constant at every time step; in analogy to the chemical potential of a quantum gas which is introduced for the conservation of particle number. According to this reasoning, condensation of resources to a single player analogous to BEC is expected at low temperature where vanishes.

To study this prediction, we simulate the multiplicative process Eq. 7, adopting a standard density function,

 (14)

where . We find two distinct phases for the distribution of the normalized cumulative gain . At high , obeys the Bose distribution (FIG. 1-a). At low , the coordinated distribution breaks down: players with low energy (high ability) dominate a large fraction of the cumulative gain. This condensate exists only below a critical point . For, if is negative, of the player with does not converge. Its normalized cumulative gain can not be incorporated in the integral in Eq. 13; rather it has to be added as an extra term. The critical temperature for this transition can be predicted in the usual way: Change of variables and use of in Eq. 13 yields
 (15)

By approximating the upper limit of integral in Eq. 15 by infinity, the critical temperature is given by
 (16)

for . When , this approximation is not valid because of the high critical temperature; instead, from and Eq. 15, one obtains
 (17)

The transition can be seen in the occupation by the most capable player, defined by . As decreases below , its occupation dramatically increases, supporting the prediction (FIG. 1-c).

We verified the existence of a BEC analogue in a discrete multiplicative process, as was shown in a continuous model [Bianconi and Barabasi(2001)]. However, we emphasize that, as a matter of principle, our classical dynamical system is not equivalent to a quantum gas. The most important difference is based on the following observation. The time evolution of each player's gain is different above and below the predicted . Above , the gains of all players monotonically decrease. Below , not all of them show monotonic behavior, and the competitive dynamics is disordered. The observed nonequilibrium phase transition from ordered to disordered state occurs as a violation of the stationarity in weighted mean ability, . It is stationary if the gain of all players monotonically decreases to zero, which allows the argument below Eq. 10. Otherwise, if the gain of one player rises to dominate the resources, the weighted mean ability approaches the ability of this one dominant player. Then due to the replacement of the dominant player upon the entrance of a player with higher ability, we observe an irreversible increase of the weighted mean ability, indicating that the system is now evolving. Thus dominance and evolution are aspects of nonstationary dynamics. We emphasize that the phase transition yielding evolution does not happen in equilibrium systems.

We now consider application of the theory to competition of clonal strains of asexual Escherichia coli serially propagated on glucose-limited medium. The population dynamics is most suitably described by a stochastic branching process with mutation and selection. Consider the th strain with fitness , mutation rate , and population size . Let ( ) be given by a Poisson distribution with mean Here is the number of mutants that were generated and that survived the initial step since the process started. The number of mutants produced at time , , is drawn from a Poisson distribution with mean . Note that the average total number of cells at time is fixed to due to the normalization factor in the above equations.

It is clear that our process Eq. 7 is a deterministic approximation of this stochastic population dynamics. A monotonically decreasing fitness distribution should be used because most mutations are likely to be deleterious [Fisher(1958)]. We thus decided to use the same used in the analysis of the deterministic model (and the state density Eq. 14) because it satisfies this basic tenet. Our results do not depend, however, on the precise form of the state density; other parameterizations of the fitness distribution of such as the beta distribution defined on yield essentially the same results (not shown).

Routes to Adaptive Evolution: A strong prediction of the theory is the existence of a singular point on the emergence of evolution. We observed the transition from stationary to non-stationary state in the numerical simulation of the stochastic process by decreasing the temperature . The transition point is predictable from the critical temperature obtained by the deterministic theory (Eq. 17). Above , dominance by a capable player (strain) appears. Below , the dynamics are governed by the random drift of dominant strains. The random fluctuation of dominant strains is the most striking difference from dynamics of the deterministic model.

Another route to generate an evolutionary development is to increase by fixing . The critical temperature given by Eq. 17 is proportional to , which is related to mutation rate through . We thus obtain

 (18)

Given , decreasing increases such that is achieved. A sufficiently low mutation rate not only prevents deleterious offspring but is necessary for adaptive evolution itself. The deleterious role of high mutation rate to adaptive evolution termed as `clonal interference' was observed in experiments of E. coli competition [de Visser et al.(1999)de Visser, Zeyl, Gerrish, Blanchard, and Lenski], and theoretically investigated elsewhere [Gerrish and Lenski(1998)].

Approach to the Transition Point by Natural Selection: An important question is wether is comparable to under natural conditions. Evolutionary progress observed in laboratory experiments of E. coli competition shows alteration of long periods of relative stasis with short bursts of rapid change caused by rare beneficial mutations [Elena et al.(1996)Elena, Cooper, and Lenski]. Therefore, empirically observed dynamics is consistent with model behavior at in our construct at least during early stages of competition. However, we argue that there exists a biologically plausible scenario in which may eventually become comparable to by internally tuning the parameter [Bak et al.(1987)Bak, Tang, and Wiesenfeld,Kauffman and Johnsen(1991)].

Instead of using a common fitness distribution for all strains, it is physiologically plausible to assume that each strain has its unique fitness distribution. We assume that fitness of mutants originating from the th strain of fitness is drawn from a fitness distribution characterized by the temperature . Since most mutants are deleterious, the average fitness produced with should be less than (i.e. , where for the state density Eq. 14.). Henceforth, the inverse temperature is given by

 (19)

where to satisfy .

At the beginning of adaptive evolution, strains with higher fitness are chosen by natural selection. Dominance by strains with high fitness increases the average temperature of the population. Suppose that adaptive evolution achieves a neutral condition, . It is then by chance wether or not a certain strain is picked up. Since a dominant strain is prone to produce mutants inferior to the dominant strain itself, those deleterious strains are likely to be picked up, and the average temperature decreases. There are ever going cycles of adaptive evolution, neutral state then collapse of the dominance (FIG. 2). The advantage of the dynamics that approaches criticality is rather clear. It allows initial adaptive evolution, permanently eliminating unfavorable genotypes, but then significantly slowing down or preventing further evolution and dominance: close to the critical state, strains can co-exist for a substantial period of time. Diversity introduced by the dynamics near criticality is clearly advantageous for the whole ecosystem, which is exposed to global environmental changes. We thus conjecture that this strategy might be taken by some haploid species.

We thank H.G. Schuster and S. Shinomoto for very helpful comments. Supported by the Murata Overseas Scholarship Foundation (HS) and NIH grant R01 NS43188-01A1 (EN).

Next: Bibliography
hideaki 2005-10-05