Why you should not try to beat the market

Beat the Market: Clickbait or Realistic Goal?
Beat the market is one of the most recycled promises in finance. An entire industry depends on convincing you to try. Even the investors you respect most are, structurally, singing the same song. This article unpacks the argument and its internal contradictions.
The headline appears with predictable regularity. An investor, a fund manager, or a new strategy has beaten the market. The implication is always the same: you could too, if only you followed the right approach, subscribed to the right service, or paid the right professional.
The financial media runs on this premise for 24/7 entertainment and engagement. The asset management industry does the same to secure management fees. You, as an investor, have equally strong incentives to interrogate it carefully before acting on it.
Before any discussion of benchmarks, beating markets, or active versus passive strategies, there is a more fundamental question that almost nobody asks: what should you expect to earn for taking no risk at all?
Start at Zero Risk
Every serious discussion of investment returns should begin with the risk-free rate: the return available on the safest possible asset, with essentially no probability of loss. In practice, this means short-term government bonds issued by financially stable states. For a US dollar investor, the benchmark is typically a US Treasury bill. For a euro-area investor, it is the equivalent German Bund. Based on your country and currency, you can identify the most suitable short-term government bond as your personal floor.
The risk-free rate is not an abstraction. As of mid-May 2026, the 3-month US Treasury bill yields around 3.7% annually. That means a US dollar investor can currently earn roughly 3.7% per year by doing nothing: no analysis, no risk, no decisions beyond buying the instrument. The 10-year US Treasury, which carries some additional duration risk in exchange for locking up capital longer, yields around 4.4%.
These numbers matter because they define the floor. Any investment that does not meaningfully exceed the risk-free rate is not compensating you adequately for the additional risk, illiquidity, and complexity you are taking on. A stock portfolio that returned 5% last year while Treasury bills returned 3.7% delivered a risk premium of roughly 1.3 percentage points (return minus risk free= risk premium).
Whether that reward justifies the volatility, the emotional cost, and the time spent is a question worth asking before celebrating the result. This is the concept of the risk premium: the excess return above the risk-free rate that investors demand in exchange for accepting uncertainty. I explored the mechanics of calculating this baseline in Calculate the Risk-free Rate of Return, and the related inflation adjustment in How to Calculate the Real Rate of Returns. Both are worth reading before you form a view on any investment’s performance.
The S&P 500 Is Not a Universal Benchmark
Once you have established the risk-free floor, the next step is choosing a benchmark appropriate to what you are actually doing. This is where most popular financial writing goes wrong, and where a great deal of misleading performance reporting originates.
The US-based S&P 500 is the most popular equity index. While it was officially introduced in 1957, academics and investment firms have access to datasets of precedent Standard Statistics (1923) and a broader 90-stock index (1926). Overall, its data is an excellent benchmark for one specific thing: a portfolio of US large-cap equities, market-cap weighted, held in US dollars. It is a reasonable reference point if that is what you own. It becomes actively misleading when applied to anything else.
Consider what the S&P 500 actually is. It has no direct exposure to Europe, Asia, or emerging markets. It has no bonds, no real estate, no commodities. It is concentrated in a single currency, regulatory environment, and economic cycle.
Analysts do note, fairly, that many of these companies generate the majority of their revenues globally, which provides some indirect international exposure. But that is a different thing from genuine geographic diversification, and it is worth keeping the distinction clear.
Now consider the comparisons routinely made against it:
– A globally diversified equity fund compared to the S&P 500: different geographies and risk profiles.
– A bond portfolio compared to the S&P 500: not even the same asset class.
– A private equity fund compared to the S&P 500: different liquidity, different time horizon, different leverage characteristics.
– A hedge fund: entirely different mandate and risk structure. An impact investment in a solar project in sub-Saharan Africa: not a comparison at all.
From a performance perspective, each of these should be judged against a benchmark appropriate to its asset class, geography, risk profile, and investment horizon.
When you buy a fund, it typically declares its own benchmark in its documentation, and that is the comparison that matters.
It is still very common, and often practical, to use the S&P 500 as a rough sense-check on any equity investment. Instead of comparing apples with apples, it is possible to say…wait, what about an orange? What is the price of oranges right now? Would I be better off with oranges than with apples?
So, such comparisons are possible, and we must be ready for them. When fund managers market their products by showing outperformance relative to the S&P 500, the first question is whether that comparison is even meaningful. Are we talking about the same risk profile, currency, diversification, liquidity, and investment duration?
That appears to be a different risk profile, presented as superior performance. Only once all these things are considered, and it is not always that easy, can we have a real comparison and judgment.
What Beating the Market Actually Means
With those two foundations established, the standard question becomes more tractable. Within a specific asset class, with a relevant benchmark chosen, does active management reliably outperform passive ownership of the benchmark?
In plain terms, for a US large-cap equity investor, does a skilled stock-picker consistently beat the S&P 500, net of fees, over a full market cycle?
The evidence is consistent and uncomfortable for the active management industry. The majority of actively managed US equity funds do not outperform the S&P 500 over sustained periods, once fees are deducted. The minority that outperforms in any given year shows little persistence: this year’s winner is not reliably next year’s winner. Identifying in advance which managers will outperform, and staying with them through the periods when they do not, is a task that defeats most professional investors, let alone private individuals managing their own savings.
Jack Bogle, who spent six decades in the investment industry before founding Vanguard, summarised the position plainly: he had never been able to beat the market consistently, had never met anyone who could do it, and had never met anyone who had met anyone who could do it. That is a useful data point from someone who spent his career surrounded by people trying.
Charles Ellis framed it differently. He described active investing as a loser’s game: not because the participants are unintelligent, but because the competition is so fierce and the costs so persistent that the odds are structurally stacked against the individual investor. I explored his thinking in more detail in 3 Ways to Beat the Market, by Charles Ellis.
The Song Every Professional Investor Must Sing
Here is where the argument becomes more interesting and requires more honesty.
Among the investors and public figures I most respect, Howard Marks, Warren Buffett, and Charlie Munger all say essentially the same thing to the ordinary retail investor: it is easy to invest and easy to make money in the capital markets. Just own the market, buy an index fund, keep costs low, stay invested, and be patient. Average returns, compounded over decades, are genuinely transformative. You do not need to be clever. You need to be consistent.
That advice is correct. It is also structurally the only advice appropriate for someone who simply needs to protect their savings and achieve long-term financial security.
Recommending the index to the retail investor costs the great investors nothing professionally, because the retail investor was never their client. Their clients are institutions, family offices, and high-net-worth individuals paying for active management that is, in the same breath, quietly framed as the superior tier.
Marks has made this explicit in his writing and interviews. Anyone can achieve average investment performance by simply investing in an S&P 500 index fund. That gives you market returns. If you want more performance, or lower risk relative to return, you need what he calls second-level thinking: a mode of analysis that goes deeper than the obvious, that asks not just what is likely to happen but what the consensus already assumes will happen, and whether the market has already priced that in. Watch him explain the idea directly: Howard Marks: Second Level Thinking (YouTube). For a closer look at his broader investment philosophy, I covered it in Mastering the Market Cycles, by Howard Marks.
The second-level thinking framework is intellectually serious and genuinely valuable. Marks is not selling you a hot tip. He is describing a real cognitive discipline that very few investors master. But notice the implicit architecture of the argument: there is a lower tier for ordinary investors, and an upper tier for those willing to think differently and better. The index is not the destination. It is the floor for people who have decided not to compete, and, implicitly, to accept being average investors.
That framing keeps the aspiration to the upper tier permanently visible. And that aspiration, however intellectually honest in its framing, consistently benefits the professional investment world.
This is not a deliberate manipulation. It is structural: every professional investor who speaks publicly about markets, whether consciously or not, operates within a framework that makes active management seem the serious option and passive investing the fallback. The two positions reinforce each other without either needing to be dishonest.
The Graham Framework: Naming the Tiers Honestly
Benjamin Graham, who taught Buffett at Columbia and whose thinking underlies much of what Marks and Ellis built on, gave the clearest and most honest account of this distinction.
In The Intelligent Investor, Graham divided investors into two categories. The defensive investor, also called the passive investor, places primary emphasis on avoiding serious mistakes or losses. Their second aim is freedom from effort, annoyance, and the need to make frequent decisions. For this investor, a diversified portfolio of high-quality assets maintained with minimal intervention is the correct approach. The index fund is its modern expression.
The enterprising investor, by contrast, is willing to devote serious time and effort to selecting securities. This is not a matter of temperament or ambition. It is a matter of genuine competence. Graham was explicit: the enterprising investor could expect a worthwhile reward for extra skill and effort. The keyword is skill. The enterprising investor does not earn superior returns by wanting them more. They earn them by actually being better, which requires genuine analytical ability, emotional discipline, and a willingness to be wrong and to look wrong in the short term.
Most investors who believe they are in the enterprising category are, by Graham’s actual definition, in the defensive category. They have the ambition without the competence, which is a dangerous combination. They take on the risks and costs of active management without the edge that would justify those costs.
The Subtle Ego Hook
The subtlety of the appeal is worth pausing over. The version sold by the best minds in the business is more seductive than ordinary financial clickbait precisely because it is more sophisticated.
The financial media sells excitement: hot stocks, market timing calls, the thrill of an edge. That is an obvious trap and most experienced investors learn to ignore it. The version offered by Marks and Buffett is different in tone.
The message is not: you can get rich quickly. The message is more measured: skilled, disciplined investors can deliver returns above what the average investor earns through passive ownership. That appeals not to greed but to intellectual ambition. After all, who genuinely wants to settle for being average?
The honest answer is that the aspiration to be above average is not wrong in itself. The problem is the gap between aspiration and realistic self-assessment. Ellis identified three ways a skilled investor could, in principle, outperform: better information, a better view of the future, or better behaviour over time. Most investors attempt the first two and ignore the third, which is the only one that actually delivers consistent results for most people. Better behaviour means staying invested, resisting panic, avoiding excessive costs, and not confusing a run of good returns with evidence of skill.
Being right may be a necessary condition for investment success, but it won’t be sufficient. You must be more right than others, which by definition means your thinking has to be different. — Howard Marks, The Most Important Thing
That is a high bar. Most investors who test themselves against it honestly conclude they do not clear it. Which brings them, if they are honest, back to the index. Here is Marks making the case for what the above-average path actually demands: If You Want to Become an Above Average Investor (YouTube).
The Professional Asymmetry Nobody Mentions
Professional fund managers invest other people’s money. Their income comes from management fees charged regardless of performance. If a fund underperforms, the manager loses some clients over time, but does not lose personal capital the way you lose personal capital when your savings fall in value. They can launch a new fund after a previous one fails, raise fresh capital, and begin again. That option does not exist for the ordinary investor managing their own retirement savings.
When a great investor tells you that superior returns are achievable with the right approach, they are telling the truth about their game, played among hundreds of active managers competing with each other for an edge. Whether it is the truth about your game is a different question. The consequences of losing are not the same, and the resources available to play are not the same either.
Average Is Not a Consolation Prize
There is one more point worth making clearly, because it gets lost in the conversation about beating benchmarks.
Accepting average market returns does not mean accepting a passive or undemanding relationship with your finances. Even embracing a simple index-based approach, there is a substantial amount to get right: the appropriate allocation between equities, bonds, and other asset classes for your stage of life and risk tolerance; the funding discipline to invest consistently through bull and bear markets alike; the savings rate you maintain outside the portfolio; the control of expenses and lifestyle inflation that determines how much you can actually invest. None of that is trivial.
The portfolio is one lever among several. For most people at most stages of life, what happens outside the portfolio, how much you earn, how much you save, how much you spend, how early you start, matters more to the final outcome than whether you earned 7% or 9% on what you invested. The pursuit of an extra two percentage points of return, if it comes with higher costs, more complexity, and a greater risk of behavioural error, is frequently a bad trade even when the extra return is achievable.
The investor who holds a low-cost global index fund, funds it consistently, controls their lifestyle, and stays invested through volatility is doing something genuinely difficult and genuinely valuable. They are not settling for second best. They are executing a strategy that the majority of professional active managers fail to beat after costs. That is worth naming clearly, without apology. What you do outside your portfolio, and how you manage the human side of investing, is not a footnote to the financial decision. It is the decision. I explored the broader relationship between portfolio discipline and personal financial freedom in Protect Your Time and Energy, which covers the same underlying principle from a different angle.
What to Do Instead
The practical conclusion follows from the analysis, not from modesty.
Start with the risk-free rate. Know what you could earn for taking no risk. Then choose a benchmark appropriate to what you are actually doing, not the one that happens to be on television. Then ask whether your investment, net of fees, taxes, and the time you spent on it, delivers a return that justifies the gap above that baseline.
For most retail investors, most of the time, the answer points toward staying invested across full cycles through a broadly diversified, low-cost index fund tracking a benchmark like the S&P 500 or the MSCI World. This approach captures the long-run return of the capital markets without the friction of active management costs and without the behavioural risks of constant trading.
The Rule of 72 offers a useful anchor. At a 7% annual return, a reasonable long-run expectation from a diversified equity index, money doubles roughly every ten years. Compounded over thirty or forty years, that is genuinely transformative, and it requires no second-level thinking. The investor who stays in the market, reinvests returns, keeps costs low, and avoids large emotional errors will almost certainly outperform the investor who spends those same decades trying to beat it.
If you do aspire to the enterprising tier in Graham’s sense, the first honest question is not which stocks to buy. It is whether you genuinely have the knowledge, the temperament, and the willingness to be wrong that the upper tier actually requires. Most people who ask that question carefully end up back at the index.
A Final Thought
The investors who tell you to buy an index are giving you honest advice. They are also operating within a worldview that keeps the aspirational tier permanently visible, and that serves the professional investment world far more than it serves most of their audience. This is not a contradiction that makes their advice wrong. It is simply worth seeing clearly.
Graham named the distinction honestly seventy years ago. The defensive investor accepts decent returns with minimal effort. The enterprising investor earns the right to do more, but only by genuinely being better. Most people who attempt the second path with the competence of the first end up with the costs of both and the benefits of neither.
Before you ask whether you beat the market, ask which market, measured how, compared to what baseline, net of what costs. The answer to those questions is often more informative than the performance number itself.
Time in the market matters more than timing the market. Be the market. Sweat the assets you have, steadily, without drama.
Keep it real. Sweat Your Assets.
Have you enjoyed this article on why you should not try to beat the market (#119)? Don’t miss upcoming ones. Subscribe for free to my monthly newsletter here.