There are always profits, and losses, to be had through attempting to beat the market. The trick is whether anyone can consistently beat the market, time and time again, such that their long-term return reliably exceeds that of the market itself.
The point is is that it becomes easier to beat the market the more people are indexing. Thus there become more people consistently beating the market. Identification of such is still an issue, but not as difficult.
"Look more closely at those gaudy returns, however, and you may see something startling. The truth is that very few professional investors have actually managed to outperform the rising market consistently over those years. In fact, based on the updated findings and definitions of a particular study, it appears that no mutual fund managers have."
At this point, Mutual Funds are the bottom of the barrel with respect to attracting talent for active management. There are plenty of examples of active funds that have consistently beat the market.
ex: Since Horseman's inception in February 2001, the fund has achieved annualized returns of 14.79%, according to HSBC.
According to A Random Walk Down Wall Street, there are many examples of funds that have consistently beat the market over 5-10 years, but there are very few that outperform the market over a longer time horizon, and oftentimes they underperforming in the subsequent time periods (Peter Lynch's Magellan fund is the one counterexample given).
I'm as big a boglehead as there is. Nevertheless, imagine you're the only person in the world not indexing. It's going to be quite easy to beat the market. Everyone else in existence is using market cap as the sole criterion for determining where to put their money. In this case all the other indicators for success are being ignored and not priced into the current price of the stock. In other words, if the whole world indexes the market becomes very inefficient.
> There are always profits, and losses, to be had through attempting to beat the market.
In this context the problem is that buying into an index fund does beat the market, because it simultaneously creates and then takes advantage of a bubble in the price of stocks in the index. The price of indexed stocks goes up because index funds are buying them. Then people buy into index funds because they're going up.
In theory non-index investors will then sell the indexed stocks once they're overpriced, but they can see the feedback loop. If more people are expected to invest in index funds in the future then the future demand for indexed shares will be even higher and the indexed shares will be worth even more tomorrow, so they become part of the bubble instead of correcting it.
The article and discussion confound indexes with markets with sector investment strategies.
The SP500 is not the market or even a market, its a small sector selected by backwards view of the recent past top 500 large caps.
So buying an index fund that tracks SP500 means some churn as previously successful large companies are added, and recently unsuccessful large companies are removed.
A trivial example of SP500 beating the market (of all stocks) would be new regulations or whatever resulting in increased costs and harm to small cap stocks. Its not hard to imagine... a fixed cost of regulation that might shut down your local independent gas station might be a rounding error at BP. Imagine an accounting change that costs the same to implement no matter if you're talking about thousands or billions. Or PCI/DSS change. Anyway in that situation the small caps would drag down the market average but have no effect on the large caps in SP500, so the SP500 "would beat the market" easily.
Well you just turned the point from a financial to a semantic one.
What really is the market?
We could discuss it for hours, but the reality is that (US )"market" in finance does refer to the S&P500.
So "beating the market" always means beating the S&P500.
An index fund is not its index. The distinction is important because the latter does not include management fees, transaction costs, and financing. From here it's easy to see how an index fund might beat the market.
For that, I'd refer to http://longbets.org/362/ .