PHYSICAL REVIE%' A VOLUME 34, NUMBER 3
Effective noise of the Lorenz attractor C.
Nico1isInstitut d'Aeronornie Spatiale deBelgique, Avenue Circulaire 3,
B-)
180Bruxe11es,BelgiumG.
NicolisFaculte desSciences de 1'Universite Libre de Bruxelles, Campus Plaine, Code Postal 226, Boulevard du Triomphe, B-1050Bruxelles, Belgium
(Received 27 January 1986)
The Lorenz equations are cast in the form ofasingle stochastic differential equation in which a
"deterministic" part representing a bistable dynamical system isforced by a "noise" process. The properties of this effective noise are analyzed numerically. An analytically derived fluctuation- dissipation-like relationship baking the variance ofthe noise tothe system sparameters provides a satisfactory fitting ofthe numerical results. The connection between the onset ofchaotic dynamics and the breakdown ofthe separation between the characteristic time scales ofthe variables ofthe original system isdiscussed.
I.
INTRODUCTIONChaotic attractors constitute the natural models
of
physical systems whose evolution has a limited degreeof
predictabihty, even though it can be traced back to a well-defined setof
rules. A probabilistic description is clearly the most adequate approach to such dynamical systems. In this respect the question can be raised, wheth- er asystem giving rise to a chaotic attractor can becast in the formof
a setof
stochastic evolution laws, in which a"deterministic" part and an "effective noise" part can be identified. The present paper describes a procedure lead- ing to this decomposition. The Lorenz model is used throughout the analysis, but it will become clear that the ideas are quite general and should be applicable to a wide class
of
systems.InSec.
II
we transform the Lorenz model to acanonical form in which the linearized part around the trivial solu- tion Xp—
Yp=Zp =0
becomes diagonal. This form isthe precursorof
the reduction to the center manifold which holds near the bifurcation pointof
nontri»ai steady-state solutions. Here we follow, however, a different procedure which amounts toexpressing the two variables which are fast near bifurcation, as functionalsof
the slow variable.The resulting equation is cast in Sec.
III,
in the formof
a"stochastic"
differential equation. Some propertiesof
the deterministic and"noise"
parts are identified analytically.Extensive numerica1 computations, carried out in Sec. IV, allow us to sharpen these properties further and suggest an interesting picture, whereby the chaotic dynalnics on the Lorenz attractor can be viewed as a noise-induced transition. Themain conclusions are drawn in
Sec. V.
dY =rX — F — XZ,
dt
=XF —
bZ.
dt
We have used standard notation.
o,
b,r
are real positive parameters. We hereafter flx b=
—,', o'=10,
and user
as bifurcation parameter.It
is well-known that atr=
1 the trivial steady-state solution Xp— —
Yp——Zp— — 0
undergoesa
bifurcation to nontrivial solutions. In phase space this is reflected by the fact that for
r
&1this state behaves like a saddle possessinga
one-dimensional unstable manifold and atwo-dimensional stable manifold.For r&-24
74the.
nontrivial steady states become unstable via a subcritical Hopf bifurcation. Furthermore, numerical simulations show that for
rr
&24.06 a
chaotic attractor emerges.In order toincorporate explicitly in the description the unstable manifold
of
the reference state Xp=
Yp=Zp =0,
which is known to play an important role in the structure
of
the attractor, we transform Eqs. (1)intoa
canonical form in which the linearized part becomes diagonal. This amounts to solving the eigenvalue problem(2)
II.
CANONICAL FORM OF THELORENZ EQUATIONSThe Lorenz equations
read' It
is easy tosee that the eigenvalues coare given by34 2384
1986
The American Physical SocietyEFFECTIVENOISE OF THE
I,
GRENZ ATTRACTORcp)
— —
—,'I
—(o+1)+ [(o+ I)'+4o(r — 1)]' 'I
co2
— —
—,'I
— (o+1) — [(o+1) +4o(r — 1)]' 'I,
Q)3
= —
6The transformation matrix,
T ', of
(1)into the canonical form is constructed in termsof
the corresponding eigen- vectors. A straightforward calculation givesFor small g, a property expected to be valid near
r=
1, Eq.(7b) admits solutions such thatrip-0(f
),given by(7c) Substituting into the first equation (5) we then obtain, keeping again only the dominant terms in r
—
1,dg' o
(r — 1)g+o(o+
1)rip(f },
dt
o+1
or, using (7c),
T
—1CO~
—
N2N~
—
N2(4) dg o
(»
-1)g-
erdt
o'+
1 b(o+
1)Operating on both sides
of
(1)byT
' we thus arrive at the formd(
cpz+1=cog+
[(cp &+1)(+
(cpz+1)rt]g,
dt
r
(N~—
N2)d'g
co]+
1=
N2'p- [(ep,+1)g+
(cp,+1)rt]g,
r(cp&
—
c02)=cp3(+ —
1[(cp,+ 1)g+
(cp,+ 1)rt](g+ ri),
r
in which g,rt,g are related to the original variables
X,
Y,Z
through=T
'F
rN~
—
COpThis equation turns out to be identical to the normal form
of
the bifurcation equationsof
the Lorenz system nearr= l. (
is therefore the natural order parameter in this range. Alternatively, we may say thatEq.
(8) represents the projectionof
the original equations into the center manifold associated to the reference state Xp—
Fp=
Zp= 0.
Notice that, despite the hnearityof
the transformationT [Eq.
(6)], nonlinear effects are kept through the adiabatic elimination procedure [Eqs.(7a} and (7b)]. In other words everything happens asif
the transformation, when applied to g, is nonlinear. This pro- cedure leads tocompletely consistent results nearr= l.
In this paper we are interested in the behavior
of
the Lorenz system in the chaotic region for which the reduc- tion leading toEq.
(8) is clearly inadequate, as r &pl in this range. Nevertheless„we may still identify apart ripof
and a part gp
of
g corresponding todrtldt=O, dgldt=O
asif
Tikhonov's theorem were valid, and sup- plement the description by adding the deviations 5r),5(
around these parts. This is carried out explicitly in
Sec.
III.
Let us first outline the properties
of
Eqs. (5) in the vi- cinityof
the first bifurcation pointr= 1.
The characteris- tic roots co& and cp2 behave in this range as[cf. Eq.
(3)]cp~-(cr/cr+
l)(r — 1},
cpz(cr+1}+— O(— — r — 1).
In otherwords the variable g varies on a much slower scale com- pared to rt and g. Bythe Tikhonov theorem we are thus allowed to set
drt dg
rip+3 1
— —
2 grip+2 1 2g2
a
and express
g,
g (hereafter denoted by rip, gp in this ap- proximation) as functionsof
g. This gives, to the dom- inant order inr —
1k=
1b
(4 onp)(k+Vp»—
(7a) where r)psatisfies the cubic equationIII.
FROM THECANGNICAI. FORM TOTHESTOCHASTICDIFFERENTIAL EQUATION DESCRIPTION
0p=
1[(~i+1%+(~2+1)np](k+np»
br
k))+
1rip=
[(~i+14+(~2+1)np]kp .
rcp2(c0,
—
cpq)(10a) (10b) g
=rip(g)+5'(t),
g=gp(g)+g'(t),
where rip gp satisfy dripldt=O, dgpldt=O. From Eqs.(5) we see that g is connected
to
rip, gp through the following generalizationof
Eqs.(7a) and (7b):5
(cr+1)
From these relations we essily see that gp satisfies the cu- bic equation
C.NICOI ISAND G.NICOLIS 2(co
i+
1)rto+
1+
1
bio+
coz+1
I'
(coi+
1)(coi+
1)r
cozb(coi—
coz)(coi+
1)z+1}
(2+1)
(+1)( +1)
(+1)'
(10c)ta)
I
I
r
es~
eg'~ 'I
I
~t
l
-20 10 20
i+0—
10
The manifolds defined by Eqs. (10a) and (10b) enjoy some interesting properties. First, they contain the exact steady-state solution
of
the original system„which, in gen- eral, is not the case for the center manifold. Second, the velocity field on their intersection rio ric(——
g) is parallel to the directionof
g while on traversing the manifolds it changes orientation with respect to the ri and/or g direc- tions. Equations (10a) and (10b) provide, therefore, the generalizationof
the notionof
the null clines familiar from two-dimensional dynamical systems. Figures 1(a) and 1(b) depict the dependenceof
the riand g projectionsof
the intersection curve upon gforr=28. For
reference the steady-state points have been placed, and the projec- tionof
the chaotic attractor on the (vi,g) and (g,g)planes drawn. The picture suggests that these curves represent some kindof "mean"
motion. This idea will be imple- mented further in the sequel tothis paper.We now turn to 5z)(t),
5((t).
Substituting Eqs. (9) into the last twoof
Eqs.(5)weobtain(coi+ 1)(coz+1)
ko(P
5z)r
(COi—
COz)(COi+1)
[(co
i+
1)g+
(coz+1)z)o(g)]5(
r
(COi—
COz)(co,
+ 1)(coz+1)
5ri5$, r
(COi—
COz)dg'
1dt
= — r [(coi+coz+2)(+2(coz+
1)]5z)—
bg'+ —
(coz+1)5g (1lb}Finally, introducing (9)into the first
Eq.
(5)we getdg
~z(~z+1}
=CO,
(+ q,(g)+E(g,
t).
t a))+1
Here gc(g)is provided by
Eq.
(10c),F
(g, t)is given by N2+1F(g',t)
= [(coi+ 1)g+(coz+
1)bio(g)]5((t)r(CO,
—
COz)(coz+1)'
gp(g}5g(t)
r
COiCOz-
(coz+ 1)
5ri(t)5$(t),
r
COi—
COz (12b)coz(coz+1)
(()(g,)
— =
COig,+
rto(ks)=0
69)+
1and itis understood that
5', g'
are to bedrawn from Eqs.(1la) and (1lb).
We are now in the position toformulate the central idea
of
the present work. We suggest thatEq.
(12a) can be viewed as a stochastic differential equation, in which a deterministic evolution described by the first two terms is continuously perturbed by the noiseF(g, t}.
The roleof
the latter isto correct the Tikhonov approximation, which is no longer adequate for
r
&&1,by incorporating the ef- fectof
the time changeof
the two variables 5ri,g'.
This becomes the sourceof
a chaotic time evolutionof
the vari- able g, which can be thoughtof
as a response to the sto- chastic forcing functionF(g, t).
Let us give some preliminary arguments in support
of
this idea. As expected from the remarks made after Eqs.
(10),the zeros
of
the deterministic part,1
-20 -10 10
1
20
FIG.
1. The solid lines depict the dependence ofq [Fig.1(a}]and g [Fig. 1(b)] on g as given by Eqs. (10a)
—
(10c}forr=28.
The dots stand for the projection of the Lorenz attractor, respectively, in the (vy,
f}
and (g,g'}planes. The crosses indicate the location ofthe nontrivia1 steady states.are the exact steady-state solutions
of
the original system.Significantly, linear stability analysis shows that they remain asymptotically stable in the whole range
of
valuesof
r, fromr=
1 to well within the chaotic region. A use- ful visualizationof
this property, to which we also come back later, is provided byFig.
2, sphere the kinetic poten- tial2387
I I I I
500-
-1000 -500—
-10 10
I I I I I I I I
20 &0
FIG.
2. Kinetic potential corresponding to the "determinis- tic" part ofEq. (12a)forr=28.
g,o. trivial steady state.nontrivial steady states.
500-
(b)
I C
U(g)= — I dip(g)
is plotted against gfor
r= 28.
We observe two minima lo- cated on the nontrivial steady states and one maximum on the trivial steady-state indicating, respectively, the asymp- totic stability and the instabilityof
these states. The pres- enceof
the noiseF
perturbs this stateof
affairs by intro- ducinga
continuous hopping between the two potential wells, which will be perceived as chaos. In a sense there- fore, the chaotic dynamics on the Lorenz attractor can be viewed as a noise induce-d transition. The capabilityof
the noise to provoke such a transition is to be sought in the fact thatF
contains memory effects. Indeed, by ex- pressing formally 5ri,5(
as functionsof
g and tfrom(I
la) and (1lb) one gets an integral form displaying a memory kernel.As long as the value
of
the parameterr
isbelow the on- setof
chaosrr, F
(g,t}
is bound todecay tozero as r~
Oc.For
mostof
these r's the decay will be accompanied by damped oscillations, a remnantof
the Hopf bifurcation occurring atr =rp. For r ~rz
however, we expect thatF(g,
r) will exhibit a permanent aperiodic behavior, which will entrain the otherwise stable dynamicsof
g and bring it on the Lorenz attractor. In the next section wecompare these ideasto
the resultsof
numerical simulations, which will also allow us to characterize more sharply the natureof
the noise term.-500
"
0.0I
0.005—
I
-600
I
-300 0
F(t) 300
I I I I I I I I I
-400 -200 0 200 000
600
IV. NUMERICAL EXPERIMENTS
The numerical simulation
of
the deterministic and sto- chastic partsof Eq.
(12a) is carried out as follows. We first integrate numerically the full setof
Eqs. (5). For each valueof
g and r, the qiuintities ric(g) and go(g) are determined through Eqs. (10a)— (10c).
Subtracting ric,go from the numerically computed q and g [Eqs. (5}]one deduces the valuesof
the excess quantities5', 5$.
Substi-tution
of
these values into (12b) gives finally the instan- taneous valueof
the noisetom, F(g,
r).Figure 3(a) depicts the time dependence
of E
forr =28.
Although the variation looks rather erratic, there exists
I
10
I
30
I
50
FIG.
3. (a) Time dependence ofthe effective noise term I', Eq. (12a). (b)Two-dimensional phase portrait constructed from the time series of Fig. 3(a) and the delayed time series corre- sponding tov.=1.
5. {c)Stationary probability distribution of I' compared toaGaussian (smooth line) having the same variance.(d)Power spectrum of
I'.
All calculations have been performed forr=28.
C.NICOLIS AND G.NICOLIS some structure which persists when the integration iscar-
ried out for longer periods
of
time. The two-dimensional phase-space picture obtained from the time series using time delayed values[Fig.
3(b)]allows one to visualize the kindof
structure involved. As we see the noise visits the state space in a more isotropic fashion as compared to Fig. 1(a). Moreover, the densityof
states ishighly nonun- iform with clear preference for states near the origin.Fig. 3(c) depicts the stationary probability distribution
of F.
We see that this function exhibits a long tail and a very sharp peak around zero.It
is thus very different from aGaussian having the same variance [smooth lineof
Fig.3(c)].
In addition[Fig.
3(d)], the power spectrum presents a maximum at some finite frequency close tothe imaginary partof
the eigenvaluesof
the linearized Eqs. (1) around the nontriuia! steady states, and fallsoff
rather slowly for larger frequencies. This kindof
spectrum is qualitatively similar to thatof
a damped oscillator forced by white noiseW(t):
20-
0.04
0.03
I I I
20
I I
40
I I I
80
I I I I I I I I
(a)
dF dF
z
+2cog +roQ=
W'(t).
dt dt (14a) 0.02
(14b) Indeed, taking the Fourier transform
of
(14a) and denot- ing the varianceof
Wby b, we obtain+2 (coo
—
ro )+4'
roof0.01
-20 -$0 10 20
which presents a maximum at co=coo(1
—
2$)'~.
Al- though no quantitative fit is claimed, a qualitative con- nection along the above lines is natural indeed, since the noiseF
incorporates information about the Hopf bifurca- tion occurring in the original equations (1) around the nontrivial steady statesX,
+— — F,
+— — +b(r —
1),Z, =r — 1.
This observation should also be compared to Takeyama's analysis in which the Lorenz equations are reduced to a single second-order equation forthe variable
X
containing apart describing a damped oscillator and a part associat- ed to memory effects.Let us now turn to the variable
f, Eq.
(12a). Since thenoise
F
is nonwhite, g is bound to be non-Markovian.Figure 4(a) depicts its time dependence. We see a very clear structure, to be contrasted from the rather erratic time dependence
of F
inFig.
3(a). The stationary proba- bility distributionof
g is also much closer tothe Gaussian[Fig.
4(b)]. Finally, its power spectrum decreases monoto- nously, being qualitative similar to ared noise intermedi- atebetween white noise and Ornstein-Uhlenbeck process.Figure 4(a) also substantiates the idea expressed earlier in this paper, namely that in the representation afforded by
Eq.
(12a) the system performs rapid transitions be- tween statesof
positive and negative g after spending in the vicinityof
these states an amountof
time which, typi- cally, is longer than the transition time. This is reminis- centof
the diffusionof
a particle in the double potential wellof Fig.
2, and one is tempted to inquire whether a Kramers-type theory can account at least qualitatively for the observed behavior. Now, forr=28
the varianceof F
turns out tobe about32200.
The varianceof
awhite noise having the same corrdation integral asI
turns outtobe about
30000.
The potential barrier associated totheI I
(cj
I
2'5
I
75
FIG.
4. (a),(b), and (c) as (a), (c),and {d) in Fig. 3for the variable g.transition,
AU=U(g,
o)— U(g,
) is about 498, whereas the second derivativeof
Uat g,o and g, is, respectively,—
12 and31.
This gives a Kramers timeof
about0.
2, to be contrasted with the numerically computed residence timev=1. 7.
This failure is to be attributed primarily to the large valueof
the variance compared to the heightof
the potential barrier, a property that automatically places us outside the range
of
validityof
Kramers's theory. An alternative manifestationof
itis the fact, clearly recogniz- able inFig.
4(b), that the system visits with appreciable probability an extended intervalof
states and not only the immediate vicinityof
the minimaof
the kinetic potential.So far we reported the results
of
numerical simulations for fixed parameter values r=28.
We now investigate the34
dependence
of
the variable g andof
the effective noiseF
on r, starting from values
r
close to the thresholdof
chaotic motion,r~-24. 06
and going up tor=30.
Figure 5 describes the main result. We sm that the varianceof
g (dotted line in the figure) vanishes forr (rT
{in agree-ment with the remarks made at the end
of
Sec.III),
ex- periences afinite jump atr =rT,
and varies subsequently withr
in an almost linear fashion. This result can be un- derstood qualitatively as follows. Since the random char- acterof
g is connected to the jumps performed between the two deterministic solutions g,+ across the value g,o=O under the effectof
noise, one expects thatdg
dt
= U"
(g,o)g'+5F,
or
A lower bound
of (5F )
istherefore given by(16)
(17a)
(17b)
(variance
of g)'
=(distance between g,+
and &e,&&)or,using (6) and (3)
r+ —
I (o—
1)2 1
[(o+1)i+4o(r — 1)]'~i +
X[b(r — 1)]' '
Figure 5 (solid line) depicts this dependence for
r
&24.1.
We see that the agreement with the numerically computed variance is good, considering the simplicity
of
the argu- ments involved. We are therefore allowed torefer torela- tion (15) as an approximate fluctuation dissipatio-n theorem linking the statisticsof
gtothe phenomenologi- cal coefficients appearing in the equationsof
evolution.Let us now turn tothe dependence
of
the varianceof F
on
r
In view. of
the structureof
the Lorenz attractor and, in particular, its connection with the separatricesof
the unstable state Xo——Fo——Zo— — 0,
me expect that the strengthof F
should be related to the rate with which the system leaves the unstable state g,o. According toEq.
(12a)this rate is given by the second derivative
of
the ki- netic potential evaluated atg=g,
o. A reasonable estimate would therefore betolinearize (12a) around g,o——0,Figure 6 (solid line) depicts the right-hand side as a func- tion
of r.
The result, viewed as a lower bound, is rather satisfactory. Estimating(5$ )
fromEq.
(15)leads us to a relation hnking the statisticsof F
to the phenomenologi- cal coefficients, which could therefore beviewed as an ap- proximate fluctuation-dissipation theoremof
the second kind.'cV. CONCLUDING REMARKS
The principal idea followed in this work isthat it might be useful to cast the evolution
of
a multivariable system into a form displaying a limited numberof
privileged variables subjected to stochastic forcings. When applied to the Lorenz model this idea leads to the selectionof
a single variable, g, andof
asingle noise process,F.
AsF
is neither Gaussian nor white, g has complex statistical properties and, in particular, it is a non-Markovian pro- cess.Our results give some interesting insights on chaotic dynamics. Thus, we have seen that the emergence
of
chaos in the Lorenz model is associated tothe breakdownof
the time scale separation between different variables.This gives a precise meaning to the assertion frequency found in the literature that the elimination
of
fast vari- ables generates noise in the subsetof
the slow variables.This belief, which isat the heart
of
the crucial separation between "diagnostic" and "prognostic" variables in meteorology, should be reconsidered carefully in the lightof
the results reported in the present paper.150— 30000'
~4~yI ~0~
~ ~~
~ ~
0 ~ ~
e ~ ~ ~
~~
~ ~ ~
~~ ~ y 0
~~~
4 ~
~ ~ g ~ 0
100- []6F}2) 20000
'50— 10000-
1
2i 26 29
1
25
I
26
I
27
l
29
FICi. 5. Numerically computed variance of g (dots) and its analytical estimate from Eq. (15)(solid line).
FIG.
6. Numerically computed variance ofthe effective noiseF
(dots) and the lower bound provided by Eq.(17b)(solid line).2390 C.NICOLIS AND
G.
NICOLIS 34 An interesting extensionof
our work would be to de-fine, in chaotic dynamics, universality classes correspond- ing to typical separation mechanisms between deterrninis- ticpart and effective noise part.
For
instance, the Rossler model" is likely to belong to aclass in which the deter- ministic part is associated to a limit cycle or to a homo- clinic orbit, ' contrary to the bistable system representa- tionof
theI.
orenz model. When applied to the Rossler model, our procedure would lead to an order parameter related to the radiusof
the limit cycle. In principle, the equations replacing the auxiliary relations (10a)and (10b) need no longer yield the exact steady state solutions for this system. Such classification schemes should be useful in tackling the "inverse" problem, namely, given an exper- imental time series exhibiting an appreciable randomness determine the mechanisms that might be responsible for the observed behavior.For
instance, many complex sys- tems encountered in nature are probed experimentally through a single variable or through a limited numberof
key variables. The resulting time series (think, for in- stance,
of
meteorological or climatic data) is almost al- ways noisy. Separating the deterministic and the "ran-dom" part
of
such a series is therefore a necessary task which, usually, is carried out by statistical regression methods. '3 In as much asmanyof
the signals observed in nature result primarily from an intrinsic dynamics rather than from extrinsic noise, statistical methods cannot tell the whole story. We therefore suggest that complex time series describing natural phenomena should first be analyzed from the standpointof
the theoryof
dynamical systems to see whether the phenomenonof
interest can be associated to alow-dimensional attractor. 'lf
the answer to this question is in the affirmative, like, for instance, inre:ent
work by the authors on the climatic system, 's the analysis reported in the present paper should be applicable and lead to a simplified representationof
the evolution, which might be useful forthe purposesof
modeling.ACKNO% LEDGMENT
This work was supported, in part, by the European Economic Community under Contract No.
ST2J-0079-1- B(EDB).
~E.Lorenz,
J.
Atmos. Sci. 20, 130 (1963).2C. Sparrow, The
I.
orenz Equations (Springer, Berlin, 1982).sW. Wasow, Asymptotic Expansions for Ordinary Differential Equations (%'iley, New York, 1965}.
~J. Guckenheimer and Ph. Holmes, nonlinear Oscillations, Dynamical Systems and Bifurcations
of
Vector Fields(Springer, Berlin, 1983).
5%'. Horsthemke and
R.
Lefever, Poise-r'nduced Transitions (Springer, Berlin, 1984).6K.Takeyama, Prog.Theor. Phys. 60, 613 (1978).
7C. Gardiner, Handbook
of
Stochastic Methods (Springer, Ber- lin, 1983).R.Benzi, in Rem Perspectives in Climate Modeling, edited by A.Berger and and C.Nicolis (Elsevier, New York, 1984).
R.
Kubo,J.
Phys. Soc. Jpn. 12, 570 (1957);S.De Groot and P.Mazur, Nonequilibrium Thermodynamics (North-Holland, Amsterdam, 1962);H.
8,
Callen andT.
A. Welton, Phys.Re@ 83, 34(1951}.
oL.Landau and
E.
Lifshitz, I'luid Mechanics (Pergamon, Lon- don, 1959).' O.Rossler, Ann. N.Y.Acad. Sci.316,376(1979).
'2P.Gaspard and G.Nicolis,
J.
Stat.Phys. 31,499 (1983).See, e.g., G.Jenkins and D. Watts, Spectral Analysis and Its Application (Holden-oay, San Francisco, 1968).
'See, for instance, N. Packard,
J.
Crutchfield,J.
Farmer, andR.
Shaw, Phys. Rev.Lett. 45, 712 (1980).'5C.Nicolis and G.Nicolis, Nature 311,529(1984).