Академический Документы
Профессиональный Документы
Культура Документы
I. INTRODUCTION
63 051913-1
1
.
2p 1 p
K i (t)
K i t 1 if
j1
x i j K i t 1
K i t , otherwise;
composed by two 0 s and one 1. Hence, a random connection is cut K i (t1)2 and another Boolean function with
bias p0.5 is assigned. A new state is then computed.
In a sandpilelike system there is a decrease in the mass,
energy, tension, etc. at the boundaries 20,21. In the proposed RBN, there is a decrease in the number of connections. Our system is a random graph with no boundaries. But,
there is a diffusion effect that is able to cause an avalanche of
disconnections. If one automaton connection is cut at t), its
state can change from 1 to 0 at t1). The last change may
cause a disconnection at t1) in any of the automata that
are connected to the first one, and so on until a stationary
state is reached.
K i t1
III. RESULTS
051913-2
self-overlap is a(t1)0.5 due to the random state initialization. It can be observed that the self-overlap grows
quickly reaching the stationary value a * 1 for high values
of the bias. This is to be expected because in the critical
boundary with KK c , the self-overlap reaches the value
a(t)1 for the first time. On the other hand, for low values
of the bias, the self-overlap is stable at a value lower than 1.
We will show in Sec. V that this is an RBN size effect.
FIG. 5. Evolution of the average self-overlap a(t) for the simulations of Fig. 2 (t is the number of iterations.
051913-3
051913-4
K t
FIG. 9. Power spectrum log-log of the mean connectivity evolution K(t) of a RBN (p0.65 and N10 000). It is the average of
305 temporal series of 16 384 steps. The slope of the dotted line is
1.920.09. Inset: a particular case of the evolution of the
mean connectivity K(t) for the average series (t is the number of
iterations.
P k t k,
10a
P k t1 1 k1 1a k1 t P k1 t
k 1 k a k t P k t ,
10b
P 2 t1 1 3 1a 3 t P 3 t P 2 t , 10c
where k9,8, . . . ,3. The variable k p k kp k1 (1p) is
the automaton probability to maintain its connectivity by
chance. Equation 10a describes the loss of connections for
all the automata with connectivity 10 at instant t. The rest of
the Eqs. 10b, except for the last one Eq. 10c, have two
contributions: the first one represents the creation of automata with connectivity k that previously had connectivity
k1, and the second one describes the automata that maintain their same value of connectivity k. The last equation
Eq. 10c describes the growth of automata population with
connectivity 2. The evolution of the critical self-organized
RBN is described by the coupled system of Eqs. 8 and
10a10c.
One can see that a * 1 is the only possible value that
makes the probability distribution stationary. In Eq. 8, a *
1 is a fixed point when K * (1P)1, where K * K(t
) is the asymptotic connectivity, that is, whenever the
stationary mean connectivity satisfies
K *
1
,
2 p 1 p
11
k2
k3
k 1 k a k t P k t ,
12
051913-5
L *
K * 1P
*
10 1 10 P 10
k 1 k P *
k
*
k1 1 k1 P k1
3 1 3 P 3*
14
P K * 1P 1 9 0,
15
Thus,
13
051913-6
FIG. 12. Evolution of the mean connectivity K(t) (t is the number of iterations: the lines correspond to the theoretical results and
the symbols to the averaged simulations. We have considered the
same cases as in Fig. 11.
The theoretical analysis fits with the numerical simulations and it is able to predict RBN behaviors to govern variations. We tested other disconnection rules similar to 6 and
7: for example, we changed the breaking threshold of a
connection. If there is a disconnection when no 0 inputs
arrive to the automata, the system stabilizes under the critical
curve. If there is a disconnection when there are more than
one 0 inputs in the automata, the system stabilizes over the
critical curve. In the theoretical analysis, these modifications
imply that the probabilities k change. In the first case the
probabilities increase and in the second case they decrease.
The values of these probabilities control the rate at which the
mean connectivity decreases. In the first case, the rate is
greater and the self-overlap reaches the value 1 deep inside
the ordered phase. In the second case, the rate is very small
and the net stabilizes in the disordered phase with selfoverlap lower than 1. There is a range for the values of the
k functions that gives the correct rate. The chosen rule
produces values in that range. From the theoretical point of
view it seems easy to obtain similar results using a fixed
connectivity and changing the bias, or modifying both of
them simultaneously.
Much future work is open. We think that the order-control
coupling parameter proposed in 11 also works for RBN.
And vice versa: the proposed method in this article works in
this type of binary neural nets. In order to consider biological
implications the automata to be considered as genes dynamics and the disconnection rule to be thought of as mutations should have different characteristic times. We should
also include a rule that allows for a possible connection
growth, and not simply consider connection loss as we have
051913-7
done in this article. We think that the point of view considered here can have further applications along these lines. In
any case, we can extrapolate our results to a different type of
nets that show a clear transition between the ordered and
disordered phases with well-defined order and control parameters.
ACKNOWLEDGMENTS
The authors would like to thank C. Molina-Pars, U. Bastolla, and S. C. Manrubia for their critical reading of the
manuscript. This work has been supported by Centro de Astrobiologa CAB.
12
13
14
15
16
17
18
19
20
21
22
051913-8