Index Funds vs. Active Management: What 50 Years of Data Actually Shows
The debate between passive and active investing is not really a debate anymore — the data has been in for decades. Here is what the evidence shows, why it is routinely ignored, and what it means for your portfolio.
Admin
Author
Do active fund managers beat the market?
The data answer is unambiguous: most do not, and the minority that do cannot be reliably identified in advance.
The S&P Dow Jones SPIVA (S&P Indices Versus Active) report, published semi-annually since 2002, is the most comprehensive ongoing analysis of active versus passive performance. The 2024 report found that over the preceding 20-year period:
- 95% of US large-cap active fund managers underperformed the S&P 500
- 92% of mid-cap active managers underperformed their benchmark
- 95% of small-cap active managers underperformed their benchmark
This is not a recent phenomenon or a specific market condition. The underperformance is persistent, cross-asset-class, and international.
Why do active managers underperform?
The explanation is more structural than it is about manager competence. Three compounding factors:
1. Cost drag
The average actively managed mutual fund charges an expense ratio of approximately 0.5–1.5% per year. The average index fund charges 0.03–0.1%.
On a $100,000 portfolio compounded over 30 years at 7% gross return:
- With 0.05% costs: approximately $743,000
- With 1.0% costs: approximately $574,000
The cost differential compounds to a $169,000 difference — from the same underlying market returns. This is not a behavioural story; it is arithmetic.
2. The zero-sum nature of markets
Before costs, active management is a zero-sum game: for every fund that beats the market, another must underperform by the same amount. Aggregate active management equals the market return by definition (because active managers collectively hold the market).
After costs, active management is a negative-sum game: all active managers in aggregate must underperform the market by exactly the total costs they charge.
This is William Sharpe's 1991 argument in "The Arithmetic of Active Management" — not an empirical claim that can be falsified, but a mathematical identity.
3. Survivorship bias
Fund databases only include funds that survived. Underperforming funds are closed and merged into better-performing funds, erasing their track record from histories. This means raw performance databases overstate active manager performance by including only survivors.
Morningstar research estimates that over a 10-year period, approximately 50–60% of active funds are closed or merged. The reported average active fund performance excludes these.
When survivorship bias is corrected for, the outperformance numbers become worse.
What about top-performing active managers?
The most common challenge to passive investing: surely the top-quartile managers demonstrate persistent skill that allows investors to identify them in advance?
Research by Vanguard and Dimensional Fund Advisors consistently finds that past performance predicts future performance only weakly and over short horizons, and that this predictability disappears entirely after controlling for factor exposures (value, size, momentum) that index funds can now capture cheaply.
The most famous demonstration: S&P's Persistence Scorecard (separate from SPIVA) finds that among top-quartile funds in a given five-year period, roughly 25% remain top-quartile in the subsequent five years — exactly what you would expect from random chance.
There are genuine exceptions — Simons' Renaissance Medallion fund is the most compelling case of sustained, apparently skill-based outperformance. But the Medallion fund is closed to outside investors and operates with strategies unavailable to retail investors.
What is factor investing (smart beta)?
Factor investing is the systematic exploitation of return premiums associated with specific stock characteristics — value, size, profitability, momentum, low volatility — identified through academic research.
The major factors (Fama-French five-factor model):
- Market beta — compensates for systematic market risk
- Size — small-cap stocks have historically returned more than large-cap
- Value — stocks trading at low multiples of book value have historically outperformed growth stocks
- Profitability — highly profitable firms outperform low-profitability firms
- Investment — firms with conservative investment outperform aggressive investors
Factor investing sits between pure passive and traditional active management — it exploits systematic return sources at lower cost than active stock picking. Dimensional Fund Advisors has built a substantial business on this approach.
The debate: some factor premiums have diminished since publication (consistent with the efficient market hypothesis — identified inefficiencies attract capital and close), and factor strategies have extended periods of underperformance that test investor discipline.
What does this mean practically for a long-term investor?
The evidence supports a simple portfolio strategy that the majority of professional investors and financial advisers are reluctant to recommend, partly because it requires little professional involvement:
- Invest in broad, low-cost index funds — total market (US and international) and bond market
- Minimise costs — target expense ratios under 0.1%; Vanguard, Fidelity, and iShares all offer options in this range
- Set an asset allocation appropriate to your time horizon (typically more equity when young, more bonds approaching retirement)
- Rebalance annually — sell appreciated assets, buy underperformed ones, maintaining target allocation
- Do not trade in response to news — market timing is empirically unsuccessful
This portfolio requires approximately two hours per year to maintain and outperforms the vast majority of actively managed alternatives over 20-year horizons.
The honest caveat
Index funds have grown from a curiosity in 1976 (when Vanguard launched the first retail index fund) to holding a plurality of equity assets. There are legitimate theoretical questions about whether passive investing at very high market share would reduce price discovery efficiency.
Current estimates suggest passive investing holds approximately 40–50% of US equity assets. Academic research has not identified empirical evidence of pricing inefficiency attributable to passive investing at current levels. Whether this changes at higher passive market share is an open research question.