Stability analysis of imitative dynamics in two-community with multiple delays

Evolutionary game dynamics has become a hot topic in recent years. In this paper, we combine game theory and dynamical systems to investigate the stability of imitative dynamics in two-community with different kinds of delays. First, we establish a new model of imitative dynamics in two-community. Then, three sufficient conditions of the asymptotical stability for the neutrally stable strategy of the imitative dynamics are obtained. Finally, numerical simulations are consistent with the theoretical analysis.

Imitative dynamic is a generalization of replicator dynamic, which can spread the successful strategy more likely than replicator dynamic. In recent years, imitative dynamic has been discussed in different fields by many researchers [21][22][23][24][25]. Cheung [21] studied the imitative dynamics for games with continuous strategy space, they obtained global convergence and local stability results for imitative dynamics. Wang et al. [22] investigated the imitation dynamics with delay, they obtained a sufficient condition for two-phenotype imitative model and gave some numerical simulations for three-phenotype imitative model. Hu et al. [25] researched the imitative dynamics with discrete delay, they obtained some sufficient conditions of stability in imitative dynamics.
Time delay can represent those processes requiring time to occur such as incubation and transportation, which is ubiquitous in physics, biology, or social systems. Since the important effect of the time delay, many researchers have studied the replicator dynamics with time delay [26][27][28][29][30]. Tao et al. [26] first proposed the effect of time delay and evolutionary stable strategy, they found that time delay would affect the stability of the replicator dynamics. Nesrine et al. [27] researched the discrete and continuous delays in replicator dynamics, they derived some necessary and sufficient delay-independent conditions for replicator dynamics. Wesson et al. [28] discussed the Hopf bifurcation in two-strategy and three-strategy delayed replicator dynamics, they showed that the bifurcation and limit cycles would exhibit in delayed replicator dynamics.
As we all know, the research in this field is mainly focused on the same community where the individual has no choice to interact with the opponent in the other communities. Nevertheless, in social networks and biology [31,32], the population is formed by different communities which can be called clusters. In this case, the individual may interact with an opponent inside or outside the community. Nesrune et al. [32] considered evolutionary dynamics in interacting communities, they researched the two-community two-strategy model and obtained some sufficient conditions for stability. However, the delay between two communities is the same, it may be different in two communities in an actual system.
Based on previous literature, we aim to generalize the model in [32] and discuss (i) the delays are diverse in two communities; (ii) a new signification parameter α (0 < α < 1). In our model, the dynamics can be considered as a stochastic combination with diverse delays. We research the effect of diversity delay on the stability in a new model and obtain three sufficient conditions for stability in imitative dynamics with different delays. Our results show that the interior equilibrium in imitative dynamics is asymptotically stable when the delay is smaller than the critical value. The present paper is structured as follows. First, we recall the main concepts of evolutionary dynamics, imitative dynamics, and asymmetric delay in Sect. 2. Then the model and stability analysis of the neutrally stable strategy is researched in Sect. 3. At last, the numerical analysis is given by snowdrift games in Sect. 4.

Preliminary
In this section, we recall neutrally stable strategy, two-community imitative dynamics, and asymmetric delay.

Neutrally stable strategy
In the previous literature, we have seen that the evolutionarily stable strategy (ESS) [33] is important in the evolutionary dynamics. In this paper, a special kind of ESS called neutrally stable strategy (NSS) is discussed.
The definition means that NSS is different from the ESS, while the former requires that no mutant thrive in the sense of earning a higher payoff than the incumbent strategy, the latter requires that no mutant strategy persist in the sense of earning an equal or higher payoff.

Two-community imitative dynamics
The imitative dynamics can describe the evolution of various strategies in the communities. In two-community, the individual from each community may interact with an opponent from the same or different communities. Assume that p i denotes the probability that the opponent is from the same community i (i = 1, 2), and {M i , N i } is the strategy set in each community. The population profile can be defined by x = (x i , y i ), where x i is the frequency of the strategy M i in community i and y i is the frequency of the strategy N i in community i. The payoff matrix of the two-strategy in community is From the payoff matrix, one can obtain the payoff of each strategy as follows: The imitative dynamics in two-community can been written as follows: Since x 1 (t) + y 1 (t) = 1, x 2 (t) + y 2 (t) = 1, Eq. (2.1) can be calculated and simplified as follows: where the parameters are presented in Table 1.
The fully mixed NSS is asymptotically stable.

Asymmetric delay
Assume that The asymmetric delay is the case where only interactions between individuals with different strategies are delayed, while interactions between individuals with the same strategy may be instantaneous. Therefore, we definē For ease of notation, we would introduce an incremental formula between two strategies: Especially, (i) α = 0 means the increment is zero, i.e., the fixed delay, which has been researched in [30]; (ii) α = 1 means the case of asymmetric delay; (iii) when values of α are between 0 and 1, the dynamics can be regarded as a stochastic combination. While interactions with individuals adopting the other strategy are always delayed by τ , interactions with individuals adopting one's own strategy are instantaneous with probability α and delayed with probability 1α.

The main result
In this section, we consider two-community imitative dynamics with diverse delays.

Two-community with asymmetric delay
In this subsection, we assume that the strategies take an asymmetric delay τ . The corresponding imitative dynamics for the two-community is given as follows: where A 11 , A 22 , A 12 , A 21 , C 1 , C 2 are given in Table 1.
For convenience of research, we introduce a small perturbation around x * : z 1 (t) = x 1 (t)x * 1 , z 2 (t) = x 2 (t)x * 2 . Then we can obtain the linearized form of Eq. ( 3.1): where which has been discussed in [35]. Similar to the results in the literature, we obtain the theorem for the stability of the mixed NSS for Eq. ( 3.1).

Theorem 1 The mixed NSS x * in Eq. (3.1) is asymptotically stable if
Proof Taking the Laplace transform of system ( 3.2), we can obtain the corresponding characteristic equation as follows: By substituting the exponential term with a Taylor series expansion and keeping only linear terms in τ in the above equation, one can obtain the simplified characteristic equation The zero solution is asymptotically stable if all solutions of ( 3.2) have negative real parts, i.e., x * is asymptotically stable if all the roots of the characteristic equation have negative real parts. In this case, the roots of Eq. ( 3.2) have negative real parts if their product is positive and their sum is negative: By Lemma 1, one can obtain k 1 > 0, k 2 + k 3 = δ 1 δ 2 Q > 0. Therefore, the condition (i) yields τ < 1 k 1 (1-α) . Condition (ii) yields: if (k 2 (1α)k 3 ) > 0, then τ < k 1 2(k 2 (1-α)+k 3 ) ; if (k 2 (1α) + k 3 ) < 0, the conclusion would be established for all τ .
In a sum, we can obtain τ <τ = min{ 1 k 1 (1-α) , Remark 3.1 The result in Theorem 1 gives an upper bound on strategic delays for which NSS remains asymptotically stable in two-community with asymmetric delay.

Two-community with asymmetric and diverse delays
In this subsection, we research two kinds of different delays in two-community.

Two-community with asymmetric delay
Assume that τ 1 denotes the delay associated with the inter-community interactions and τ 2 denotes that two individuals from different communities get involved in an interaction. The corresponding imitative dynamics for the two-community is given by Similar to the results in [35], we obtain the theorem on the stability of the NSS for Eq. ( 3.4).
Proof Similar to the proof in Theorem 1, the corresponding characteristic equation can be written as follows: The roots of Eq. ( 3.6) have negative real parts if their product is positive and their sum is negative, i.e., Using similar methods in the proof of Theorem 1, one can obtain τ 1 <τ = 1 k 1 (1-α) and (ii) k 2 (1α)τ 1 + k 3 τ 2 < k 1 2 .
Remark 3.2 The result in Theorem 2 gives an upper bound of τ 1 and the linear combination of τ 1 and τ 2 for which the mixed NSS remains asymptotically stable in two-community with different delays.

Two-community with diverse delays
Let τ i be the delay associated with the inter community i, and τ 12 be the delay when two individuals from different communities get involved in an interaction. The corresponding imitative dynamics for the two-community are given by (3.7) Similarly, one can obtain the linearized form of Eq. ( 3.7) as follows: Similar to the results, we obtain the theorem on the stability of the NSS for Eq. ( 3.7).

Numerical simulation
In this section, we give numerical simulation to verify that our results are effective. We consider the classical snowdrift game [36,37], where the player may use a cooperate (C) strategy or a defect (D) strategy. According to the relevant literature, we can get the payoff matrix of the snowdrift game as follows: where b represents the payoff of going home and c represents the cost of shoveling snow. We apply our model to the snowdrift game played in a population composed of two communities of players having different behaviors. Players in community 1 are more selfless, and players in community 2 are more selfish.
In this case, the payoff between communities 1 and 2 is described by the matrix where ω (0.5 < ω < 1) is the proposition of the cost when a selfless player competes with a selfish player.  Fig. 1, we observe a convergence to the intermediate NSS s * when τ <τ . However, the oscillation phenomenon appears when τ >τ (see Fig. 1). At the same time, the result implies that the amplitude and the period of the solution will increase with the increase of τ (see Fig. 2).
Example 1 explains the effect of the same delay on the stability of the NSS, which is consistent with Theorem 1.  According to the conditions in Theorem 2, we obtain that the stability should satisfy two conditions: (i) τ 1 + τ 2 < 10.0931 and (ii) 0.5163τ 1 + 0.5485τ 2 < 2.5. In Fig. 3, it is clear that the intermediate NSS is stable when τ 1 and τ 2 satisfy the conditions, but when the linear combination of τ 1 and τ 2 does not satisfy condition (i) or (ii), then s * is unstable.
Example 2 verifies the effect of different delays (case 1) on the stability of the mixed NSS, which is consistent with Theorem 2. Assume that (i) 0.6967τ 1 + 0.6219τ 2 < 1.6667 and (ii) 0.26(τ 1 + τ 2 ) -0.07τ 12 < 1.3186. In Fig. 4, it is clear that the NSS is stable when τ 1 and τ 2 satisfy the conditions, and when the linear combination of τ 1 and τ 2 does not satisfy condition (i) or (ii), then s * is unstable.
Example 3 describes the effect of off-diagonal and different delay (case 2) on the stability of the mixed NSS, which is consistent with Theorem 3.

Conclusion
In this paper, the stability of the NSS in two-community has been investigated for the imitative dynamics with diverse delays. Compared with the model in [32], we introduce a new signification parameter α and discuss the different delays in different communities, which is more meaningful in actual social networks. Three sufficient conditions for the imitative dynamics with diverse delays are derived. The results indicate that the different delays have different effects in the community, which is different from the results in [32].
Furthermore, we will research the two-community imitative dynamics with continuous distributed delays. At the same time, the current theoretical model and numerical simulation are only considered in the imitative dynamics; we plan to discuss the stability for other dynamics such as logit dynamics or best-response dynamics.