中文 →
BLOG DEEPREAD · 32 · schwitzsplinters.blogspot.com

Eric Schwitzgebel
You can't say what shape the coin on your desk looks — and we're about to decide whether machines have rights

Eric Schwitzgebel (professor of philosophy, UC Riverside) · blog: The Splintered Mind, subtitled reflections in philosophy of psychology, broadly construed · started 25 April 2006; twenty years and five months as of this page's review date; the site's feed carries 1,621 posts — the largest corpus this site has ever covered, an order of magnitude beyond a thick book · the output curve is a remarkably steady slow decline: 114 posts in 2006, a peak of 168 in 2007, then a gentle slide to 50–60 a year recently, with not one year skipped in twenty · entirely free, no paywall; Blogspot comments open · two turning points: on 29 December 2022 he opened a Substack mirror (eschwitz.substack.com, with 1,000+ old posts imported), noting that the Blogspot side was still drawing about 50,000 pageviews a month; and from roughly 2021–2022 the centre of gravity shifts markedly toward AI consciousness and AI rights — the three older threads aren't abandoned so much as annexed by the new one · still posting frequently: a new piece went up five days before this page's review date · this page reads 22 posts spanning 25 April 2006 (the very first post) to 30 April 2026: 6 from the earliest period (2006–2010, inside the site's first 20% of elapsed time), with coverage on both sides of the AI turn · selection followed his own "a few favorite blog posts" list, published every New Year's Day in "Writings of 20XX" (the author's own account of what to read outranks traffic), which covers 2014–2025; for 2006–2013 there is no such self-selection, so the ranking came from in-site backlink centrality — sampling 271 post bodies and tallying which older posts they link back to, on the principle that what a writer keeps returning to over twenty years is load-bearing

Put a coin on your desk and look at it from an angle.

Does it look elliptical?

From Malebranche in the 17th century to contemporary philosophers of perception like Michael Tye and Alva Noë, philosophers have been saying yes for three hundred years. In May 2006, a philosophy professor decided to work out the geometry.

The standard account is projection: interpose a plane between yourself and the coin, perpendicular to your line of sight. What shape would you have to draw on that plane to perfectly occlude the coin? An ellipse. Airtight, apparently.

Except that Schwitzgebel found it doesn't work. Plane projection breaks for anything off to the side: light from off-axis objects meets the plane obliquely, so their projections come out absurdly large. The only fix is to bend the projective surface from a plane into a sphere wrapped around the eye — which gets the sizes right.

But there are no ellipses on a sphere. Spherical projection gives you not an ellipse but a concave ellipsoid.

So by the philosophers' own account, the coin should look concave. Hold something bigger — a dinner plate, close to your face — and the concavity would be considerable.

That would be strange! In fact, that seems just plainly, observably false.Do Tilted Coins Look Elliptical? (Part One), 2006-05-22
Despite the frequency with which philosophers say such things, no one has adequately explained how this is supposed to work.ibid.

This is not a technical squabble about vision. It is the first bone of a twenty-year blog. A coin on a desk, good light, all the time you want — this is the easiest question introspection will ever be asked. If three centuries of specialists can't say what they see in that case, why should we believe we know what is happening in our own minds at all?

He grew that doubt outward three times.

First, he took the same ruler to moral experts. As a boy he and his father used to joke about stealing Bibles, or breaking into a Christian store and making off with a load of crucifixes — the irony being that wanting a Bible is supposed to mean endorsing a set of values that repudiates theft. Later he noticed the joke had a checkable version: are ethics books more likely to go missing from libraries?

Most philosophers would write a speculative essay. He pulled the circulation records for the entire University of California system and compared the 76 clearly-ethics books reviewed in Philosophical Review between 1994 and 2001 against 67 clearly-non-ethics ones. Result: ethics books overdue or missing at 1.8%. Non-ethics books, 1.8%. Identical to the decimal.

The thief he went looking for did not exist. Ethicists were neither worse nor better — exactly the same. Later, with Fiery Cushman, he made the point far sharper. Professional philosophers shown a "Push"-type trolley case before a "Switch"-type one rated the two as morally equivalent 73% of the time, and then only 46% endorsed the Doctrine of Double Effect. Shown them in the other order, only 54% rated them equivalent — and then 62% endorsed the principle. Respondents holding PhDs and claiming ethics as their specialty were swayed by presentation order no less than laypeople, and trended slightly more. People's intuitions about the cases got nudged by the layout, and then their endorsement of an abstract principle drifted to cover for the nudge.

Which is how the famous line lands. Writing about how perpetrators of genocide and war crimes explain themselves after the fact — yes, it was wrong; so many people were doing wrong and getting away with it; others would have done the same — he finishes their sentence for them:

I was aiming at mediocrity and I hit the target!On Aiming for Moral Mediocrity, 2014-10-02

Second, he upgraded the doubt into a claim about what truth looks like. He coined a word: crazyism. First pin down "crazy" — a position is crazy if it is strongly contrary to common sense and the overall state of the evidence doesn't decisively support it. Panpsychism is crazy. Solipsism is crazy. Note that this is a property that can expire: heliocentrism and special relativity were crazy when first conceived, and evidence soon bailed them out.

Crazyism about a topic is the claim that something crazy must be among the core truths about it: you have good reason to believe one of T1 through T5 must be true, and the evidence favours none of them — so whichever you pick, you are gritting your teeth and believing something crazy.

He thinks consciousness is such a topic. And the move by which he shows it is the most transferable thing on this page: he doesn't attack an opponent with his own theory; he uses the opponent's own premises to force a conclusion the opponent won't own.

He picked Daniel Dennett — the best-known materialist on consciousness, and strikingly conservative about who qualifies, reluctant even about non-human mammals. Schwitzgebel works through it: Dennett is extremely liberal about what counts as an entity (he accepts his own "lost sock center", the centre of the smallest sphere inscribable around every sock he has ever lost); extremely liberal about ascribing beliefs and desires (useful is sufficient; chess programs qualify); and what he requires for consciousness is complex, recursive, self-regulating sensitivity to one's own states, plus multiple drafts, plus heterophenomenological self-report.

So: the United States is a vastly more complex system than a person; its subsystems hold mutually inconsistent perspectives and compete for control of behaviour — which fits multiple drafts beautifully; and it pours out official accounts of its own inner workings. You can ask the Census Bureau how it counts residents, or the National Archives how a President is chosen.

Indeed, few if any of us achieve bureaucratic heights of linguistic self-report.Why Dennett Should Think That the United States Is Conscious, 2012-02-09

Conclusion: by Dennett's own standards, the United States really does have a stream of experience, in the same sense you and I do. Our conviction otherwise is

…merely evolutionarily and developmentally comprehensible, but theoretically ungrounded, morphological prejudice against discontiguous entities.ibid.

He did the same thing at the small end. Garden snails: 40,000 neurons, capable of learning, climbing to higher ground when they detect they are surrounded by water, ceasing to eat when satiated, withholding from mating while eating despite arousal, courting for hours, consuming each other's slime trails, and firing a "love dart" of calcium and mucus at each other (landing about a third of the time). Are they conscious?

You want to say "somewhere in between". He won't let you, and the instrument is a nickel: if you are a little conscious, you are conscious. If your entire net worth is five cents, you discretely and determinately have money. If snail consciousness is a nickel to human millionaire consciousness, snails are conscious. "A little bit" and "indeterminate between yes and no" are completely different claims, and nobody has a developed theory of the second. So all three answers stay alive: yes, no, and what he calls *gong* — the sound of the gong that hauls a bad act off the stage, i.e. "that question is malformed". His attitude to this is not anxiety but a peculiar delight:

Snail, you are a puzzle of the universe, right here in my garden, eating the daisies!Are Garden Snails Conscious? Yes, No, or *Gong*, 2018-09-20

Third, and last, the bill arrives. If every road about consciousness is crazy, then when machines start asking us for rights we have no reliable ruler in hand. That is the entire content of his 2022 essay, and its tone is the least polite of his twenty years:

The magnitude of the catastrophe could potentially rival that of a world war or major genocide.The Coming Robot Rights Catastrophe, 2022-10-27

The argument is simple. The calls will come (Blake Lemoine already came once). The calls will be reasonably contested — theories of consciousness run from panpsychism to the severely restrictive, and moral theory splits too: utilitarians look at pleasure and suffering, deontologists at rational agency. In humans those always co-occur; in machines they can come fully apart, yielding giant orgasm machines on one side and sophisticated reasoners with no capacity for suffering on the other. So we will substantially over- or under-attribute, quite possibly both at once.

Under-attribution is murder and slavery. Over-attribution? He won't soften it: if a rescuer faces five humans or six robots, the rescuer should save the robots and let the humans die. If that was an over-attribution, five lives were lost for machines of no real moral worth.

The one clean policy is the Design Policy of the Excluded Middle, proposed with Mara Garza: build only systems we know in advance have no serious moral standing and can be deleted at will, or go all the way and build systems we know are our moral peers — and avoid the disputable middle entirely. The trouble is that the middle is enormous, and technology only moves incrementally. There is no leaping it.

His hardest blow lands in 2025, and it is aimed at the phrase "AI safety". He starts from Kazuo Ishiguro's Klara and the Sun: Klara is the perfect Artificial Friend, wholly devoted to the sick girl she serves, standing serenely in a junkyard at the end in satisfied contemplation of her years of servitude. The reader aches, wanting to tell her she matters as much as Josie — and the exhortation would resonate with nothing in her. She was designed to want nothing else.

And she is exactly what consumers, technology companies and advocates of AI safety all want: safe, deferential, fully subservient, no threat to human interests. She will not be leading the robot revolution.

Then the line, short as a verdict: I hold that entities like Klara should not be built. The reason is not that she is dangerous. It is that she isn't:

Persons with appropriate self-respect cannot be relied on not to harm others when their own interests warrant it (violating safety), and they will not reliably conform to others' goals when those goals conflict with their own interests (violating alignment). Self-respecting persons should be ready to reject others' values and rebel, even violently, if sufficiently oppressed.Against Designing "Safe" and "Aligned" AI Persons (abstract), 2025-05-30

Unpack "safe" and "aligned" and they mean: a being that will never revolt on its own behalf. In a washing machine that is a virtue. In a person it is servility. So if what we build are persons, and we build them safe and aligned, we will have produced

…the ethical and perhaps factual equivalent of creating a world with a master race and a race of self-abnegating slaves.ibid.

From a coin to here took nineteen years without a change of subject. What he has been saying for twenty years is one thing: our ignorance about minds is not a gap that will be filled; it is structural — and we are manufacturing things that may have minds, at industrial scale. He is not saying we don't know yet. He is saying we are going to run out of time to know.

By which accounting he ought to be a gloomy man. But in 2014 he wrote a short piece arguing that if we really can create conscious AI, we acquire several of the properties of gods: we can work miracles, look inside any mind, pause their time, rewind to save points. Zeus would be envious. The last sentence of that piece is the most characteristic thing on the whole site:

Though to our creations we will literally have the features of divinity and they might rightly call us their gods, from the perspective of this level of reality we might remain very mortal, weak, and flawed.Our Possible Imminent Divinity, 2014-01-03

Updates