Investing · Day 44

Investing Classics: The Perils of IndexingWhen Everyone Buys the Haystack

July 22, 2026·BigCat's Capital Allocator
The index fund is the friendliest invention of the past half-century for ordinary investors—low-cost, no stock-picking, and it beats most professionals over time. But once a tool becomes good enough to go mainstream, it develops side effects it never had as a niche. This week isn't an argument to leave indexing—it's an effort to see clearly four problems the tailwind narrative conveniently hides: the paradox of scale, the concentration of ownership in three giants, the weakening of price discovery, and the irreplaceable role active investing still plays within it.
PRINCIPLE 01

The Free-Rider's ParadoxThe Paradox of Scale — Indexing Free-Rides on Others

SCALE PARADOX
The Framework
Indexing works precisely because it was once a minority strategy—it free-rides on the pricing that active investors labor to produce. As passive's share climbs from the fringe to the mainstream, that very premise begins to erode. The more successful it becomes, the more it undermines the foundation of its own success.
Source · Quote
"Properly measured, the average actively managed dollar must underperform the average passively managed dollar, net of costs." — William F. Sharpe, "The Arithmetic of Active Management" (1991) Nobel laureate Sharpe laid the theoretical bedrock of indexing with a single arithmetic identity: as a group, active management must lose to passive after costs.
The Deeper Reading

Sharpe's arithmetic is iron law. The market is made of all its holders; passive investors capture the market return minus tiny costs, while active investors, as a group, can only take the market return minus higher costs—so after fees, the active average must lose to passive. This is why index funds beat most managers over time (S&P's SPIVA data show roughly 90% of U.S. active equity funds trailing their benchmark over 15 years). But the arithmetic has a silent premise: someone has to do the hard work of pricing. Index funds don't research or value anything; they simply buy everything by market-cap weight. Their "efficiency" is built on the "inefficient effort" of others.

The Case

The tipping point has already passed. Per Morningstar, in August 2019 U.S. passive equity fund assets surpassed active for the first time (each about $4.3 trillion); passive's share has climbed since. The origin makes it more ironic still: when Bogle launched the first retail index fund in 1976, peers mocked it as "Bogle's Folly," and it raised just $11.32 million. Four decades on, that "folly" went from a ridiculed fringe strategy to the single largest force in U.S. equities.

Limits · Checklist

Indexing is still the right starting point for the vast majority—the question isn't "whether to index" but "what happens when everyone does." Don't mistake wariness of scale's side effects for a case against low-cost indexing.

  • Do I index because I've thought through the cost and pricing logic, or just because "everyone does it"?
  • Do I understand that indexing's efficiency depends on others still pricing seriously?
  • Is my "index" a broad-market fund, or a narrow theme dressed as one (same marketing, higher fee)?
  • If passive's share keeps swelling, do the assumptions behind my strategy still hold?
The Essence · Reflection
Indexing is free-riding—the car moves because someone is still on the gas; as fewer people press the pedal, the free ride itself starts to change.
How much of your capital have you handed to money that "reads weights, not prices"? Of that, how much was a considered choice rather than the default of following the crowd?
PRINCIPLE 02

Three Ever-Larger HandsOwnership Concentration — The Giant Three

COMMON OWNERSHIP
The Framework
Passive money must "buy the whole market," so three index giants—BlackRock, Vanguard, State Street—have become the largest shareholder of nearly every big U.S. company. The money belongs to tens of millions of savers, but the votes concentrate in a handful of institutions. It is an unprecedented separation of ownership from control.
Source · Quote
"If historical trends continue, a handful of giant institutional investors will one day hold voting control of virtually every large U.S. corporation. I do not believe that such concentration would serve the national interest." — John C. Bogle, "Bogle Sounds a Warning on Index Funds," WSJ (2018) In his final column, the father of indexing himself sounded the alarm about the very concentration his invention helped create.
The Deeper Reading

Bebchuk & Hirst's study The Specter of the Giant Three (2019) estimates the three together hold over 20% of the S&P 500, are the largest single shareholder in roughly 90% of its companies, cast about a quarter of the votes at shareholder meetings—and the share keeps rising. Two problems follow: ① the agent of the agent—the true owners (you and I) almost never vote; the power is exercised by index funds' governance teams, whose first priority is to cut costs and grow scale, not necessarily to monitor every company; ② common ownership—the same institutions are simultaneously large shareholders of rival firms in one industry, which in theory dulls their incentive to compete against each other.

The Case

Azar, Schmalz & Tecu's Anticompetitive Effects of Common Ownership (2018, Journal of Finance) studied U.S. airlines and found common ownership associated with higher fares (an estimated 3%–7% lift). The finding is heavily contested and far from settled, yet it put a real question on the table: when the same hand holds Delta, United and Southwest, does that hand truly want the three to compete to the death? The antitrust debate it sparked is still fermenting among regulators.

Limits · Checklist

Most of the time the Giant Three vote passively, following management or advisers like ISS; "control" is more latent than exercised day to day—but latent power is still power, and the concentration only grows.

  • For my index funds, how does the manager exercise the votes held in my name? Have I read its voting policy?
  • Do I mind outsourcing corporate governance to an asset manager whose first goal is scale?
  • In an industry I care about, might common ownership be blunting competition?
  • Is there a "pass-through voting" option that returns the ballot that is rightfully mine?
The Essence · Reflection
You buy the index to stop worrying—but the price of "not worrying" is handing the whole market's votes to three ever-larger hands.
Open your largest index fund and find its annual voting record—over the past year, on which resolutions did it vote for or against in your name? Do you agree with those decisions?
PRINCIPLE 03

Price, or Echo?Weakened Price Discovery — Who Sets the Price?

INFORMATION EFFICIENCY
The Framework
Passive money doesn't ask about price; it buys by proportion. The more it buys, the more mechanically the price is pushed up—not because "the company is worth more." As an ever-larger share of capital grows indifferent to valuation, the market's ability to discover true value quietly decays.
Source · Quote
"Because information is costly, prices cannot perfectly reflect the information which is available, since if they did, those who spent resources to obtain it would receive no compensation." — Grossman & Stiglitz, "On the Impossibility of Informationally Efficient Markets" (1980) The Grossman-Stiglitz paradox: a perfectly efficient market cannot logically exist.
The Deeper Reading

This is the Grossman-Stiglitz paradox: the market needs a crowd of "inefficient" active players constantly placing bets and correcting errors for prices to mean anything. Passive money is a price taker, not a price discoverer. Gabaix & Koijen's "inelastic markets hypothesis" (2021) offers a quantitative estimate: each $1 of net inflow into equities lifts aggregate market value by roughly $5—because willing sellers are scarce, prices are acutely sensitive to flows. When large sums flow in mechanically, indifferent to valuation, a stock can rise simply because it was "added to an index."

The Case

The index-inclusion effect is a live textbook. When Tesla entered the S&P 500 in December 2020, its shares surged for months beforehand on the expectation of "forced buying" by index funds, and inclusion day was one of the largest index rebalances in history. The earlier classic is the "index-inclusion premium" documented by Shleifer (1986): a stock could gain several percentage points, with no fundamental basis, simply for being added to the S&P 500. Price here reflects the mechanical direction of money, not a judgment of value—more echo than signal.

Limits · Checklist

Price discovery hasn't failed—active money's share has fallen, but it still accounts for a high share of trading volume, and the marginal price-setter is still active. The danger is in the trend, not today; which also means that where passive is overcrowded, clear-eyed active judgment may actually have more edge.

  • Is this stock's rise driven by fundamentals, or by the mechanical inflow of index money?
  • What would happen if the company were removed from the index? (Picture a forced sell-off.)
  • Am I mistaking "heavily bought" for "endorsed by the market"?
  • In a passive-dominated, under-examined sector, is my independent judgment worth more?
The Essence · Reflection
Price is meant to be the crystallization of countless independent judgments; when more and more money only counts weights and never asks value, price degrades from "signal" into "echo."
Take the biggest gainer in your portfolio—strip out the push from two years of passive inflows, and how much of the gain is left that fundamentals actually earned?
PRINCIPLE 04

The Haystack and the Ones Who SortThe Limits of Active — and Why It Must Survive

SYMBIOTIC LIMITS
The Framework
The flip side of the paradox: because indexing weakens pricing, active opportunity should, in theory, grow again—but that doesn't mean you can seize it. Sharpe's arithmetic still holds; as a group, active still loses. The truth is symbiosis: a healthy market needs both, and an individual must be honest about which side they stand on.
Source · Quote
"Don't look for the needle in the haystack. Just buy the haystack!" — John C. Bogle, The Little Book of Common Sense Investing (2007) Bogle's most famous slogan for indexing—but the haystack is valuable precisely because someone is still doing the hard work of sorting for needles.
The Deeper Reading

The slogan needs a footnote, usually omitted, to be complete. Three layers: ① the arithmetic—Sharpe's law doesn't fail as indexing swells; after fees, active as a group still loses, so "since pricing has worsened, I'll go active" remains a trap for the ordinary investor; ② the boundary—those who can actually exploit mispricing are the few with an information edge and controlled costs, and their competition erases most of the opportunity anyway; ③ symbiosis—the market needs a "minimum" of active capital to sustain price discovery, but that share may be far lower than intuition suggests.

The Case

An honest counterpoint is "closet indexing": many funds charging active fees hold portfolios that closely track the index—having neither the low cost of indexing nor the differentiation of true active management. Cremers & Petajisto's Active Share (2009) showed that only funds with genuinely high "active share" can generate excess returns, while many are merely expensive pseudo-indexes. The lesson: "active" is no virtue in itself; differentiated and low-cost is.

Limits · Checklist

For 99% of individuals, the conclusion is still "a low-cost broad-market index at the core." This card isn't urging you to go active—it's asking you to see clearly how the free ride you're on works, and where its costs hide.

  • For my active sleeve, do I truly have an information or cognitive edge, or just feel good about it?
  • Does the active fee I pay buy a high enough "active share," or an expensive closet index?
  • Do I grasp that even as pricing worsens, active as a group still struggles to win—opportunity isn't my opportunity?
  • Can I tell my core (low-cost broad index) from my satellite (truly differentiated active), and is the ratio honest?
The Essence · Reflection
Buying the haystack is smart—but the haystack is valuable because someone is still sorting for needles; don't free-ride while imagining the driver is dispensable.
Split your portfolio into a "free-riding passive core" and a "self-driven active satellite." Over the past three years, did the latter really beat "just indexing it too"? If not, how much did you pay for the illusion of active?

Going Deeper

Will indexing really "break the market," or is this crying wolf?
In the short run it looks more like crying wolf; in the long run it warrants caution. Active trading volume still dominates today, the marginal price-setter is still active, and price discovery is far from broken. But the trend runs one way, and no one knows where the critical share lies. The rational stance isn't to flee indexing in panic, but to understand: your low-cost free ride depends on a pricing system that still runs; when its fuel (the reward to active research) is drained, the ride slows. Wariness is not the same as flight.
As a long-term individual investor, should I cut my index allocation because of this?
Almost certainly not. For the vast majority, a low-cost broad-market index remains the best starting point—Sharpe's arithmetic guarantees it. The real takeaway is to know why: understand where your returns come from and which powers (votes, pricing) you've outsourced. If you want to act, consider favoring funds that offer pass-through voting and refusing to pay active fees for a closet index—rather than abandoning indexing itself.
In the AI era, will the weakening of price discovery worsen or ease?
Both are possible. On one hand, AI slashes the cost of processing information, in theory letting more capital go "active" cheaply and supplementing price discovery. On the other, if AI strategies converge and trade in the same direction, they may amplify the mechanical and worsen fragility (recall the 2007 quant quake and various flash crashes). As pricing is increasingly done by algorithms, the classical assumption that "price reflects human judgment" is itself loosening. AI won't automatically resolve the Grossman-Stiglitz paradox—it merely gives the active player a new face.