TOPIC 8 · PHASE B

Chaos

A deterministic world you still cannot compute

2026-07-26 · Dynamics & Unpredictability

The "butterfly effect" is almost always read as "small things can change the world." The original claim runs closer to the opposite: you can never know where the butterfly is — so even in a world governed entirely by iron law, with no randomness anywhere, long-range prediction is already out.

Weather forecasts reach out about a week. They do not reach out a month. You might assume that is a shortage of data, of computing power, of model resolution. Fix all three and the answer is still a bit over a week.

Here is the counterintuitive part: that ceiling comes not from what we do not know but from what we do. The equations the atmosphere obeys are deterministic — feed in the same initial state ten thousand times and you get ten thousand identical trajectories, with no dice rolled anywhere. Deterministic, and still incomputable. Pulling those two apart was this field's most expensive lesson.

Several issues here deal with "you can't predict it," each by a different mechanism. This one is about sensitive dependence: tiny differences in the initial state amplified exponentially. Topic 9 is about how a single parameter drives a system all the way into chaos. Topic 11 splits the limits of prediction into two kinds (precision limits vs computational irreducibility). Topic 12 is about what noise itself can do. This issue answers one question only: why "deterministic" does not entail "predictable."

01Three Decimal Places

In the winter of 1961, the MIT meteorologist Edward Lorenz was running a toy weather model on a machine called a Royal McBee LGP-30 — a few dozen multiplications a second, slow enough to watch the results print out line by line.

He wanted a second look at an earlier stretch of output, so instead of starting over he restarted from the middle, typing in the numbers from the previous printout. The run that followed should have matched the old one exactly.

It didn't. The two curves tracked each other for a while, then drifted apart, and after a few simulated "months" they were describing two entirely different weathers.

The culprit turned out to be the printer. To save paper it had printed the value held in memory, 0.506127, as 0.506. What Lorenz typed back in was an initial condition truncated in the third decimal place. He wrote the episode up as the 1963 paper Deterministic Nonperiodic Flow — a title that is itself the finding: deterministic, and never repeating.

Same equations, initial values differing by 0.00001 t ≈ 13 run A run B across all of this, the two are indistinguishable from here they go their own ways time → (actual numerical solution of the Lorenz equations; vertical axis is x) x
Each trajectory is fully determined by the equations; nothing random enters. They differ only in the fifth decimal place of the initial condition. On the left half the pink line hides inside the teal one because they genuinely coincide.

The point of this figure is not that they eventually separate. It is how alike they are beforehand. The error was there from the first instant; it was merely small. It grew the whole time, and the moment it reached the size of the system itself, forecasting became guessing.

So the abstract slogan "determinism is not predictability" means exactly this picture: the equations settle everything, but your knowledge of the initial state has finite precision — always — and finite precision buys only finite time.

🌀 Biology · the fingerprints of identical twins Identical twins share a genome and a womb, yet their fingerprints differ, and forensic examiners can tell them apart on that basis. Ridge patterns are pressed into the fetal fingertip by a mechanical process with nothing especially mysterious about it; the differences come from the initial conditions — micron-scale geometry of the volar pads, the fetus's posture, local blood flow, none of it reproducible. Which yields an uncomfortable corollary: fingerprints work as identifiers not because they carry a lot of information but because they cannot be re-run. If the same genome in the same womb cannot replay the same trajectory, then any expectation of the form "copy the conditions and you copy the outcome" is going to fail wherever sensitive dependence holds.

02Precision Buys Almost No Time

The previous section said errors get amplified. This one turns that into a quantity you can compute — the single most useful step in this issue.

In a chaotic system the distance between two nearby trajectories grows roughly exponentially: d(t) ≈ d₀ · eλt. Here d₀ is the initial discrepancy and λ is the rate at which this system amplifies error, called the Lyapunov exponent. A positive λ is the core technical meaning of the word "chaos." For Lorenz's equations λ ≈ 0.9, meaning errors double about every 0.77 time units.

Now solve that backwards. If D is the largest error you can tolerate, your prediction survives for

T ≈ (1/λ) · ln(D / d₀)

Note that d₀ sits inside a logarithm. That one detail settles everything: improve the precision of your initial state tenfold and the predictable span grows by ln10/λ — a constant. Improve it tenfold again and you get the same small increment again. Exponential investment, linear return.

Vertical axis is the logarithm of the error — exponential growth is a straight line here error = size of the system itself → forecast is void 10⁻⁹ 10⁻⁶ 10⁻³ 10⁰ error ● = three starting precisions precision ×1000 and ×1000 again equal spans — every thousandfold buys the same short slice of time time
All three lines share a slope (that is λ) and differ only in where they start. They hit the "void" line at equally spaced moments — that is what the logarithm means.

In atmospheric numbers: errors double in roughly a day and a half. Even with an initial state perfect down to instrument noise, the predictability ceiling for midlatitude weather sits at about two weeks. Run the arithmetic at that doubling rate: turning a 5-day forecast into a 10-day one means cutting initial error by something like a factor of ten, and pushing five days further means another factor of ten — by which point you are up against the ceiling anyway, and past a fortnight no amount of cutting helps. That is not an engineering difficulty. It is an exchange rate.

🌀 Engineering & the history of technology · one extra day per decade There is a famous curve in the European Centre for Medium-Range Weather Forecasts' long-run assessments: forecast skill advances by roughly one day per decade — today's 6-day forecast is about as good as a 3-day forecast in the 1980s. Over the same period the computing power of forecast centres grew by seven or eight orders of magnitude. Progress is not from precision alone, of course; model physics and data assimilation both improved. But the logarithmic law is why that curve climbs linearly instead of exploding along with the hardware. The practical corollary: any roadmap of the form "a bit more compute and we'll get it right" should be discounted logarithmically in a chaotic system — ask which slice of time it is buying, and whether that slice is worth the money.
🎯 DECISION LINE

Attach a shelf life to every forecast you rely on: how fast its error doubles, times how many doublings you can absorb. Any point forecast past its shelf life comes off the dashboard — not improved, removed, replaced by a range or a set of scenarios. And before funding "more precision," ask what it returns: in a chaotic system the spend is exponential and the time you buy is linear.

03Chaos Is Not Randomness

This is the step most often skipped, and it is the only place where the word earns its keep in practice: erratic is not the same as random.

Put a chaotic signal and a noise signal side by side as curves and you usually cannot tell them apart — both jitter without visible pattern. The difference shows up plainly under a different kind of plot.

Change coordinates. Instead of drawing "how a quantity varies with time," draw the state. Take the signal's value at time t as the horizontal coordinate and its value slightly later (say 0.1 time units on) as the vertical one, and drop a point for every instant. This is called delay embedding, the standard trick for reconstructing a system's state from a one-dimensional record.

Two equally patternless signals — one change of plot and they part company signal A · chaos signal B · surrogate value against time → value against time → horizontal = value now, vertical = value a moment later a skeleton — deterministic chaos a tangle — no skeleton
Signal B is not noise picked off a shelf: it is signal A with its Fourier phases randomised. Same power spectrum, same autocorrelation, same distribution of values — only no longer generated by equations. That is why the top row really is indistinguishable. In state coordinates, A falls onto a thin curve winding through two lobes; B is a tangle with nothing to follow.

That shape on the left is a strange attractor: the system's state is confined to an object of very low dimension, circling forever, never repeating, never leaving. → ref · the Lorenz system → ref · phase space & attractors

The right-hand panel has no shape to speak of. In noise there is no constraint tying the next value to this one, so it fills the box.

Operationally the distinction becomes a test: find the handful of past states most similar to the present one, and check whether they went on to do the same thing for a short while. If they did, there is deterministic structure, short-range prediction is possible, and modelling pays. If they didn't, you are looking at noise, and no amount of model complexity does anything but fit the past.

One line to remember the difference by: chaos is highly predictable in the short run and utterly unpredictable in the long run; randomness is unpredictable at both ends.

🌀 Economics & institutions · a testable version of "technical analysis" Chartists claim that price movements contain recognisable patterns. The test above converts that claim into an experiment you can actually run: delay-embed the price series and compare it against surrogate series that preserve its mean, variance and autocorrelation. If genuine deterministic structure were present, the two should be separable. Decades of such tests find financial series essentially inseparable from their surrogates. The corollary takes a turn: saying "markets are chaotic" is in fact an endorsement of technical analysis, since chaos implies short-run structure — and the evidence does not support it. Markets look more like "heavy-tailed and close to unpredictable," which is a different pair of mechanisms, belonging to Topics 19 and 37.
🎯 DECISION LINE

Before funding a model for a pile of data that "looks like it has a pattern," run this one test: take the k historical states most similar to the current one and see whether their short-run continuations agree. If they agree, there is a skeleton and short-horizon prediction is worth the spend. If they don't, stop the modelling budget and switch to hedging and fault tolerance, because at this resolution the thing you want to predict is noise.

04What Survives

What is unpredictable is the trajectory, not the statistics. Everything usable in this issue comes from that sentence.

The shape in the previous section has two lobes (Lorenz's famous butterfly; the full picture is on the reference page). You cannot say whether step 3000 lands on the left lobe or the right one. You can say, with fair accuracy, what fraction of the long run is spent on the left, what the distribution of values looks like, how often extremes occur. Those quantities are insensitive to the initial condition — on the contrary, they are precisely what remains once the differences in initial conditions have been averaged away.

This is where weather stands to climate. Climate is not "a very long weather forecast"; it asks a different question — not whether it rains that day but where the whole rainfall distribution is moving. So the standard jab, "you can't even get next week right, why should I believe 2100," conflates two kinds of question: one about a trajectory, one about the statistics of an attractor.

The second thing still available is replacing one forecast with a crowd of them: the ensemble forecast. Since the initial state necessarily carries error, don't run a single trajectory; scatter a small cloud of initial states, run several dozen, and watch when they come apart. ECMWF and the US National Meteorological Center made this operational practice in 1992.

40 almost identical initial states, one run each right lobe left lobe still one bundle = these steps are credible the whole range is filled = from here on, only probabilities at this instant 15 of 40 are on the right lobe, 25 on the left yellow band = envelope of all 40 · coloured lines = three individual members · the ratio is reportable, "which one" is not time →
How fast they come apart is itself the information: if today's ensemble is still a bundle on day seven, predictability is high this week; if it frays on day two, say so honestly.
🌀 Astronomy · is the solar system stable The question runs from Newton to now. In 1989 Jacques Laskar's numerical integrations delivered the bad news: planetary orbits are chaotic, with a Lyapunov time of about five million years — start one metre off and after a hundred million years the position is entirely undetermined. So the field did something very much in the spirit of this issue: it changed the question. What Laskar and Gastineau reported in 2009, from 2501 slightly different orbital runs, was not "will Mercury destabilise" but "in about 1% of the runs it does." That pivot is not a surrender; it is a recognition of the exchange rate. Beyond a system's Lyapunov time, no amount of initial precision buys a definite answer — only a proportion.
🎯 DECISION LINE

Move budget from "a better model" to "a crowd of initial states for the model you have." Change the reporting format accordingly: not a number but a fan, plus one sentence on the step at which the ensemble comes apart. The spread is the first thing to report, because it is the only honest measure of how much today's particular forecast can be trusted.

05Where This Breaks Down

"Chaos" is among the most casually borrowed words in complexity science. Four boundaries before you use it.

First, the popular reading of the butterfly effect is essentially backwards. Lorenz's 1972 talk at the AAAS was titled "Does the flap of a butterfly's wings in Brazil set off a tornado in Texas?" — and even that title was supplied by the session's convener. The point was that if a perturbation that small suffices to rewrite the outcome, then no particular weather event can be traced to any particular cause. The popular version reads it as "your small good deed can change the world," which points the other way: chaos guarantees no single perturbation can be identified, aimed, or used to achieve anything. What it guarantees is that attribution fails.

Second, finding chaos in real data is very hard, and most of what was found did not hold up. From the late 1980s through the 1990s, papers reporting low-dimensional chaos appeared in economics, ecology, cardiology and EEG research. Once rigorous methods such as surrogate-data testing became standard, a good share of those conclusions collapsed — short, non-stationary, noisy records make those indicators give false positives. Seizure prediction is the emblematic case: early algorithms built on chaos measures mostly failed to beat chance under proper blinded evaluation. Detecting "there is deterministic structure" and "we can predict it" are two different achievements.

Third, chaotic does not mean uncontrollable — the least intuitive item here. In 1990 Ott, Grebogi and Yorke pointed out that precisely because the system is so sensitive to perturbation, a very small perturbation can hold it in place. A strange attractor has infinitely many unstable periodic orbits embedded in it; nudge gently at the right moments and the system can be kept on one of them. The method was later realised in lasers, electronic circuits and cardiac experiments. So "it's chaotic, might as well give up" is a mistaken inference: unpredictable and unintervenable are different properties.

Fourth, the "two-week limit" is not a promise that holds every day. The Lyapunov exponent is a long-run average. Actual predictability varies sharply with where the system currently sits — some weather patterns are forecastable to ten days, others fall apart in three. What deserves reporting is therefore never "our model is good for N days" but "today's run is good for N days." Measuring the ensemble spread is how that question gets answered.

🎒 In Practice · BigCat

  1. Engineering & systems designThe failure that goes away when you re-run it — a test that flaked once, an error seen once in production. The default response is to re-run, see green, and close the ticket. But if the system is sensitive to timing and concurrency in its initial state, re-running is not a fix, it is another draw from the same sample. What to change: record a reproduction rate rather than a yes/no (run it 200 times, count the failures), and treat "not reproducible" as evidence of sensitive dependence rather than as a mystery. The first repair is to pin the initial state — fix the random seed, fix the ordering and the scheduling — so that it becomes reproducible, and only then debug. What to stop: closing tickets because the re-run passed.
  2. ParentingA child shows some new tendency — homework resistance, an obsession, a subject suddenly slipping — and you start extrapolating ten years out. That extrapolation is exactly the kind this issue is about: the long-run shape of the trajectory is anything but insensitive to today's small difference, and for that very reason it cannot be extrapolated — not by you, not by anyone. What can be changed is a different class of thing: the statistics of an attractor are set by constraints and environment, so what to move is "what happens by default in this house every day" (when the lights go out, what is lying on the table, who is present) rather than this one performance. Give yourself a checkable action: dig out the sentence in which you predicted, six months ago, how things would be now, and settle the account. The number of times it missed is the discount rate to apply to long-range extrapolation.
  3. Practice & temperamentReviewing the day in the evening — "why was I so irritable today?" — and tracing it back to some particular thing: a message, a meeting, a remark. The mechanism says that trace carries almost no information: on the same day, meeting the same thing half an hour earlier or later could have gone entirely differently, and the "cause" you found is just the nearest point on the trajectory. Ask about something measurable instead: what state did you enter the day in — hours slept, whether the first hour went straight to someone else's agenda. Those are the initial conditions, and they are changeable; which item annoyed you first is not. What to stop: causal post-mortems on today's mood, replaced by two lines recording tomorrow's initial conditions.

🌀 Crossings

Going Deeper

If chaotic systems are predictable in the short run, who decides what "short" means?

You do, by the error you can tolerate — not the system. For one and the same system, "error under 1%" and "error under 50%" differ by a constant factor in predictable time (that is the ln(D/d₀) term). Which suggests a practical move: instead of improving the model, negotiate the tolerable error first. That is often far cheaper and buys the same order of gain.

Why do people keep calling chaos "random" when the equations are deterministic?

Because at finite precision the two carry the same usable information. Which hints at something: the distinction between deterministic and random is not about the world but about the resolution of your model. The same river is deterministic mechanics at the molecular scale and better described by turbulence statistics at the engineering scale. Which to use follows not from "what the world really is" but from your measurement precision and the question you are answering.

Can the spread of an ensemble be taken directly as a probability?

Not directly. An ensemble covers uncertainty in the initial state; error in the model itself — approximated physics, insufficient resolution — is not in there, so ensembles are routinely overconfident, spreading less than the true uncertainty. Operational practice calibrates them against historical verification (reliability diagrams, skill scores). The transferable line: any self-generated uncertainty must be checked against reality, or it measures the model's confidence rather than the world's vagueness.

If a system is provably chaotic, what is left of long-range planning?

What is left is a different class of object to plan. Trajectories cannot be planned; constraints, boundary conditions and structural parameters can — and those change the shape and statistics of the attractor, which is the only thing predictable in the long run. Judge a long-range plan by whether it promises "in three years we will be at this point" or "in three years our distribution will have moved here."

Further Reading