REF · METHOD

AR(1) & the OU Process

First-order autoregression and the Ornstein-Uhlenbeck process — the smallest tool that reads "how fast does it recover" straight out of the noise

Cited by: Topic 36 Critical slowing down & early warning signals

01The Question It Poses

A stable system comes back by itself after a disturbance, and how fast it comes back is the key measure of how much room it has left. In practice, though, you can hardly go and shove it on a schedule just to find out. You cannot shove a lake, you cannot shove a market, and you should not casually shove an organisation that is running fine.

So the question becomes: the environment is shoving the system with small random events all the time — can you run that backwards and compute "how fast it recovers" from the resulting wobble? This tool's answer is yes, and it takes a single number.

02The Rules

  1. Let x be "how far from baseline we are right now" (the baseline's value doesn't matter; only the deviation does).
  2. Each step: x(next) = α · x(now) + ε.
  3. ε is an independent random push drawn each step, mean zero, size σ. That is the ambient noise.
  4. α lies between 0 and 1: it is the fraction of the previous deviation that survives. α = 0 means instant forgetting; α near 1 means almost everything is retained.
  5. The continuous-time version is dx = −λ·x·dt + σ·dW — the process Uhlenbeck and Ornstein wrote down in 1930 for the velocity of a Brownian particle. The two are the same object in different notation: α = e−λΔt, where Δt is your sampling interval.
  6. Once it has settled, two quantities can be read straight off: the lag-1 autocorrelation equals α, and the variance = σ² ⁄ (1 − α²) (in continuous form, σ² ⁄ 2λ).

Rule 6 is where all the value sits: α is how slowly the system recovers, and it can be estimated directly from data — pair every reading with the next one, fit the simplest possible straight line, and the slope is α.

03What You See When It Runs

The three rows below use exactly the same sequence of random pushes. Only α differs.

Identical random pushes; only the single number α changes α = 0.2 spread ×1.0 α = 0.7 ×1.4 α = 0.95 ×3.1 The pushes (the noise) are identical in all three rows — only α, i.e. how slowly it recovers, differs
The pushes are identical in all three rows. Larger α means wider and stickier — no longer one value per step but long connected swells. The theoretical ratio of spread is 1 ⁄ √(1−α²), roughly ×1.0, ×1.4, ×3.1.

An easily missed detail: a large α is not only "wobbles more", it is also "wobbles more slowly". The two necessarily happen together, because they come from the same cause — the previous deviation did not decay. So in real data, rising variance and rising autocorrelation almost always travel as a pair; if one climbs and the other doesn't, you are usually looking at something else (the noise itself getting bigger, for instance).

Plot "now" against "next" and α becomes visible directly:

Plot “now” against “next” and α is the slope of the cloud α = 0.2 · fast recovery a round cloud: the next moment barely remembers this one now next α = 0.9 · slow recovery a stretched band: the next moment mostly repeats this one now next
α is the slope of that cloud. Which is also the standard way to estimate it — one least-squares line.

04What It Explains

The whole arithmetic of early warning signals. Near a tipping point the recovery rate λ goes to zero, so α goes to 1, so the variance diverges as 1 ⁄ (1−α²). The two indicators of Topic 36 — rising variance, rising autocorrelation — are not two empirical regularities; they are two consequences of this one line.

Resilience as a measurable quantity in ecology. In 1995 Ives proposed that in an ecosystem continuously driven by environmental noise, "resilience" can be defined as the amplification of population fluctuations relative to the environmental fluctuations driving them — that is, the same 1 ⁄ (1−α²). It turns a vague word into a number you can compute from a time series.

Mean-reverting prices. The spread between two closely related assets, or the basis between futures and spot, is routinely modelled as an OU process; the λ a trader estimates converts into a half-life, ln2 ⁄ λ — how long the spread takes to close halfway — which is precisely what sets the holding period.

Red noise in physics and engineering. The velocity of a Brownian particle, thermal noise in an RC circuit, and the baseline of many climate series are all this process. A useful corollary: much environmental data is inherently "red" (adjacent points correlated), so testing it for significance against a white-noise null systematically overstates significance.

What It Cannot Explain

Further Reading