Market indices and how they are built

What an index such as the S&P 500 or the Dow actually measures, why the weighting method changes the story it tells, and what that means for index funds that track them.

What an index is

An index is a number that summarises how a group of assets is doing. When a news anchor says "the market fell 1% today", they almost always mean a specific index fell 1%: in the United States usually the S&P 500 or the Dow Jones Industrial Average, elsewhere the FTSE 100, DAX, Nikkei 225 and so on.

An index is a measuring tool, like a thermometer. You cannot buy the index itself, but you can buy a fund that tries to copy it (an index fund or index ETF). The way the thermometer is built decides what temperature it shows, so it is worth understanding.

Every index answers three design questions:

  1. Which assets are in it? (the rules for selection)
  2. How much does each one count? (the weighting)
  3. When does the list change? (rebalancing and reconstitution)

Selection: who gets in

Some indices simply take "the largest N companies by size". Others use a committee and a rulebook. The S&P 500, for example, is run by an index committee at S&P Dow Jones Indices that applies eligibility criteria (such as size, how many shares are freely available to trade, liquidity and profitability) but also uses discretion over which companies join. Entry rules apply to new additions; existing members are not automatically removed the moment they drift below a threshold.

This matters because the rules decide what the index represents. "The 500 leading US companies, chosen by a committee" is a slightly different thing from "every listed US company".

Weighting: who counts most

This is where indices really differ.

Market-capitalisation weighting

Market capitalisation (market cap) is a company's share price multiplied by its number of shares. In a cap-weighted index, bigger companies get bigger weights. Most major indices, including the S&P 500, use a refinement called float adjustment: they count only shares that are actually available to the public, leaving out large blocks held by insiders or governments.

Worked example (illustrative numbers). An index has three companies:

CompanyMarket capWeight
A60060%
B30030%
C10010%

If A rises 10% and the others are flat, the index rises about 6%. If C rises 10%, the index rises only about 1%. Cap-weighted indices are dominated by their biggest members, so a handful of giants can drive most of the move.

Price weighting

The Dow Jones Industrial Average is the famous exception. S&P Dow Jones Indices describes it as a 30-stock, price-weighted index: you add up the share prices of the 30 companies and divide by a special number called the divisor. A company with a 400 share price counts four times as much as one with a 100 share price, regardless of which company is bigger.

The divisor exists so that events like stock splits or member changes do not make the index jump artificially. When a company splits its shares two-for-one, its price halves, so the divisor is adjusted to keep the index level unchanged. S&P's own explainer notes the divisor has been adjusted many times, mostly downward, so that today it effectively works as a multiplier.

Worked example (illustrative numbers). Two-stock price-weighted index: X at 300 and Y at 50, divisor 1. Index = 350. If Y doubles to 100, the index rises to 400, about 14%. If X rises by the same 50 points, to 350, the index also hits 400, yet that is only a 17% move in X versus a 100% move in Y. Price, not company size, sets the influence.

Equal weighting

Some indices give every member the same weight and rebalance back to equal at set intervals. S&P publishes an equal-weight version of the S&P 500, which acts as a proxy for "the average stock" rather than "the average dollar". In periods when the largest companies do much better than the rest, the cap-weighted and equal-weighted versions can tell very different stories.

Price return versus total return

A headline index level usually shows price return: only the change in prices. A total return version also assumes dividends are reinvested. Over many years the difference is large, because dividends are a meaningful part of long-run stock returns. When comparing a fund to an index, make sure you compare like with like.

Why indices matter to investors

Indices are more than news headlines:

Key takeaways

What to remember

"The market" in a headline is one particular index. Before you draw conclusions, ask which one, how it is weighted, and whether a few giant companies are doing most of the work.

This article is educational and not personal financial advice.

Test yourself

  1. In a cap-weighted index, which matters more: a 10% move in the largest company or a 10% move in the smallest? Answer: The largest company, because it carries the biggest weight.
  2. Why does the Dow use a divisor? Answer: To keep the index continuous when stock splits, special dividends or member changes would otherwise make it jump for non-market reasons.
  3. What is the difference between price return and total return? Answer: Price return counts only price changes; total return also includes reinvested dividends.

Sources

For educational purposes only. This is not financial advice. Investing carries risk, including losing the money you put in. Do your own research.