中文 →
Caltech Commencement · 1974

The runway is perfect and still no planes land

Richard Feynman · "Cargo Cult Science"

1974, commencement day at Caltech. A man who had won the Nobel Prize in Physics nine years earlier walks up and opens with the fact that people in the Middle Ages believed rhinoceros horn was good for potency — "another crazy idea of the Middle Ages is these hats we have on today, which is too loose in my case."

For the next half hour, Richard Feynman wishes nobody a bright future. What he delivers is an undercover report: why do people believe so many wonderful things? He spent hours floating in isolation tanks. He went to Esalen, the headquarters of California's New Age. Sitting in a hot bath there he heard the man beside him working on a woman's big toe and asking his instructor, "I feel a kind of dent. Is that the pituitary?" — and couldn't stop himself: "You're a hell of a long way from the pituitary, man."

But the funny stuff wasn't what bothered him. What bothered him were the things far more people believed, things already built into institutions: methods for teaching reading, methods for handling criminals, the efficacy of psychotherapy. These are called science — and then they intimidate ordinary people with common sense. A teacher with a good idea about how to teach reading is forced by the school system to do it another way. A mother feels guilty for the rest of her life because she didn't do "the right thing" according to the experts.

He gave the whole category a name: Cargo Cult Science. Islanders in the South Seas saw planes bring good things during the war, so they did it too: runways, fires along the sides, a man in a wooden hut with two wooden pieces on his head for headphones and bamboo sticking out for antennas — he's the controller.

They're doing everything right. The form is perfect. It looks exactly the way it looked before. But it doesn't work. No airplanes land.— Feynman, "Cargo Cult Science," 1974

What's missing? Something, Feynman says, that nobody ever states explicitly in school — you're just supposed to catch on by osmosis: a kind of utter honesty, a kind of leaning over backwards. When you run an experiment, report everything you think might make it invalid, not just what makes it look good. When you put out a theory, publish the facts that disagree with it alongside the ones that agree. In one line: hand over all the information anyone would need to judge what your contribution is worth.

The first principle is that you must not fool yourself—and you are the easiest person to fool.— Feynman, "Cargo Cult Science," 1974

And afterwards? The diagnosis was forty years early. In 2015, a collaboration of over two hundred researchers redid 100 psychology studies: 97% of the originals had produced statistically significant results, and only 36% of the replications did. He said publish it whichever way it comes out; today that has a name — Registered Reports, where the method is reviewed and the paper accepted before the results exist. The contrast: 96% of ordinary papers report that their hypothesis was supported; among Registered Reports, 44%.

But the examples holding the diagnosis up did not survive the same check. He said physics had already cured itself of this disease; twelve years later someone calculated in the American Journal of Physics that 57% of the field's own recommended values for fundamental constants had fallen outside the confidence interval the previous review had claimed — where well-calibrated would be 2%. His model experiment, the one he admired most, he got the name wrong, the year wrong, and had it secondhand from a textbook. And anthropologists gave up on "cargo cult" long ago as both inaccurate and insulting.

None of which diminishes the talk. It confirms the line: you really are the easiest person to fool.