Pages

Saturday, April 11, 2015

The indomitable benchmarks!


Article featured in the Financial Times, Bloomberg, and through many others reputable individuals (including being shared by one of the world's most famous hedge fund managers and by one famous department chair) and news places.  See sequel article "Defeated managers, in assets globally".

Active fund managers don't seem to be getting a break now, especially since their performance hasn't measured up for more than a decade.  This article continues to clarify this indefensibly calamitous position they are in.  We shed new light on how one can mathematically verify how weak these investment managers are, by also using more conservative statistics measures and more closely considering the selection of solid benchmarks themselves.

S&P Dow Jones, in concert with CRSP, recently produced an annual table showing active security managers’ performance relative to their respective benchmarks.  They also highlight a variety of decomposition diagnostics.  Last weekend the New York Times also ran an appealing column on this, primarily focused on how the portion of portfolio managers who underperformed their benchmark was nearly ¾.  And this statistic was fairly homogeneous across different time frames, ranging up to 10 years. 

Digging into these statistics further though, we see some intriguing ways to use probability theory to analyze and explain these performance differences.  What we reveal here is truly amazing, in how rare it is to straight-up underperform the market, in both statistical tests: a more liberal one, and a more conservative one.  To be clear, this isn’t just a risk-adjusted measure we are discussing; it is an absolute negative performance relative to the benchmark. 

One can examine the 10-year (quite lengthy for our purposes), equal-weighted list of their 17 fund categories and their respective benchmarks.  All units shown are in annualized %.  If you think the performance statistics below don't look great for an investment manager's skill, just wait.  It's going to get worse as we further dive into the analysis.




CATEGORY
MANAGERS
BENCHMARK
DIFFERENCE
ALL LARGE
6.8
7.7
-0.9
ALL MID
8.2
9.7
-1.6
ALL SMALL
7.4
9.0
-1.7
ALL MULTI
6.7
7.9
-1.2
LARGE GROWTH
7.2
8.6
-1.4
LARGE CORE
6.6
7.7
-1.0
LARGE VALUE
6.6
6.7
-0.1
MID GROWTH
8.2
10.0
-1.9
MID CORE
7.7
9.7
-2.0
MID VALUE
8.4
9.3
-0.9
SMALL GROWTH
7.4
9.5
-2.1
SMALL CORE
7.3
9.0
-1.7
SMALL VALUE
7.4
8.6
-1.2
MULTI GROWTH
7.4
8.5
-1.1
MULTI CORE
6.5
7.9
-1.4
MULTI VALUE
6.3
7.3
-0.9
REAL ESTATE
6.5
8.3
-1.7

The fourth column shows a lot, by focusing on just the compounded annual performance differences.  Ironically Warren Buffett used a similar layout to show his investment prowess, up until this year's 50th anniversary BRK report.  One is correctly reading this table above.  It is a clean sweep of the typical fund managers in every one of 17 categories always getting a battering by their benchmark.

If fund managers -per category- were even basically the same as the benchmark (this is part of the definition), then we’d expect that they’d outperform ½ the time.  It would make finding winning investors interesting.  But to instead, under this assumption, lose in all 17 categories is something that could only happen with a probability of (½)17, or once every 130 thousand years!  One should be asking some hard questions, because 130 thousand years ago takes us all back to the Old Stone Age, where our family trees converge to non-religious humans just figuring out to wear clothes for the first time!

We illustrate here a range of assumptions both weaker and much stronger than this (including when looking at higher-performing fund managers who still underperform their benchmark).  And we can't assume in every case that funds are simply dependent and fully-correlated with on another (this has been proven false conceptually and across other time frames).  Also bear in mind that even the generally weaker resulting assumptions are still highly significant; we should not have seen it in the history of the U.S. markets through chance alone.

But let's continue to loosen up the probability theory and try to prove that fund managers can look good.  We start by unpairing this analysis.  The typical 17 fund categories', equal-weighted performance, is 7.2%.  All but just 1 of the benchmarks (large cap value) outperformed this: 1 of 17 is only 6%!  Put differently, using just the second lowest benchmark (multi-cap value) averaging 7.3%, we see that half of the fund manager's typical performance still didn't beat that.  This is wildly significant (classical analysis of means showing a t-statistic of about 5, or more than twice what's needed for statistical significance).  

One can see below the alarming distribution chart, for both performances.  One can almost blindly pick any benchmark, and rest easy.

  
This chart above negates any idea that fund managers were actually typically performing close to their benchmarks (what’s a few percentages between you and your banker?)  But this chart shows just how ineffectual active managers have been.  In other words one can’t state that the left (managers) and right (benchmark) distributions generally align.  Rather, any random mapping of each dot on the left to a dot on the right, mostly results in connected lines that move upward, as one moves from left to the right!

Looking at the probability implications of these distributions, it’s as if fund managers weren’t even competing in these markets once weekly (and emotionally perhaps that is true).  If you are not getting a rebate, then perhaps you can take a chance on a passive index fund from now on.  Ostensibly, it's hard to find a flimsy one.

On an aside, it's worth taking a moment to catch up on some updates.  I am now on the Editorial Board for the American Statistical Association (please reach out if you would like to write an article for it.)  Additionally, we have a couple top articles in my respected alma mater, Harvard statistics department.  Also my Statistics Topics book is being reviewed by the prestigious AAAS science organization.  And we have more to come!  Including an exclusive article, advance-accepted this month by a great industry publication.  We'll also later announce where my book proceeds are being donated, and also what other prestigious banking board I have joined, and also what new readership milestone has been breached.  None of this great success would have come without the support en route from my generous friends reading and proliferating this work.  Many thanks again.

20 comments:

  1. As the older generation investors, who at least had "growing" per capital wages and income in the 80's and 90's, were at the mercy of the "fee based active" managed funds, the younger generation, with flat to declining future income prospects, are being led into passive efficient market theory robo advisor management ( 6 - 7 % compound returns over last 17 years as computed on one of the popular Robo advisor's sites ). There will be a rude awakening in 20 - 30 years when these investors will have needed 50% more compounded returns on retirement account assets in order to achieve decent terminal retirement phase asset values.

    ReplyDelete
    Replies
    1. Thanks much for the comments, Con Sys! I led PBGC's department for policy and modeling and also had risk analysis there. So I am more than familiar with actuarial modeling for retirement purposes. I think your question is popular, but asked in a backward way to the peril of many. The question should NOT be stressing what returns to expect, but rather focusing on how one can save more. And live on less during retirement. Sign up for this blog, since in a month or two I'll have another published analysis: pension related.

      Delete
    2. Quite convenient to use the start of the 2000s uptrend. Why not starting at the 2007 high? This study is plagued with data-dreading.

      "to lose in all 17 categories is something that could only happen with a probability of (½)17"

      This assume independent trials. What exactly do you mean here? This is very strange.

      Delete
    3. Thanks anonymous. Unfortunately, your comments don't make any sense. The 5-year results would actually be the same as the 10-year results. You should do your homework. It's a clean sweep in all 17 of 17 fund categories. Also if I used top quartile cut-offs, the results only then started to look like the benchmark. So your arguments hold little ground.

      Additionally, I show a number of statistics, with a range of assumptions. Don't be lazy with your ideas. Instead of coughing up random nonsense concerning investment probability, a topic for which you appear ill-qualified, perhaps you can take your anonymous presence to a lower-order station.

      Delete
    4. Different "Anonymous" here. I don't know what "data-dreading" is (data-mining?). The time period isn't very relevant, as you said, the numbers would be worse over the last five years - I've seen the data. However, to get (0.5)^17 as the probability that all categories underperform assumes that each categories under/over performance is independent. This is NOT the case as some categories are actually sub-categories e.g., All Large = Large Core + Large Value + Large Growth. I'm a big advocate of "passive" investing, however I think you just made an over-simplified assumption here.

      Delete
    5. We illustrate here a RANGE of assumptions both stronger and weaker than this. And we can't assume in every case that funds are simply dependent and correlated with on another (this proven false across all other time frames). Also bear in mind that EVEN the generally weaker resulting assumptions are still highly significant (we should not have seen it in the history of the U.S. markets through chance alone.)

      Delete
    6. This comment has been removed by a blog administrator.

      Delete
    7. Thanks; and revisited by popular demand: http://statisticalideas.blogspot.com/2016/04/defeated-managers-in-assets-globally.html OR https://twitter.com/salilstatistics/status/719718670805676033

      Delete
  2. Salil, aren't you really just highlighting Sharpe's Arithmetic of Active Management? Basically, on the average, it is impossible for Active Management to do well because they trade against each other and get the market return less expenses. I'm not sure how you are classifying Active v. Passive and I hold a ton of index funds. However, I think structured quant-style funds like DFA and AQR and RAFI would be consistently in the top third say of "Active" and beat indexes. Factor investing compared to old school stock picking.

    ReplyDelete
    Replies
    1. Hi Matt, the stream of return differences shown in the article above are indeed all negative. But that's only this year, and those negative values are not correlated to the smaller differences in fees among them. Hedge funds must be evaluated against other hedge funds and their math of continuously outperforming should be made more difficult over time.

      Now without fussing over the details here, the article linked below shows that over the past decade hedge fund managers have still been collecting high fees(!), while dishing back returns that have only trailed a reasonable, 60/40 balanced fund, let alone the S&P 500.

      http://www.wsj.com/articles/SB10001424052702303749904579580382179546404

      Consider for yourself their worth. Another interesting idea is that if you would like to see the dear cost paid for employing leverage, then you'd enjoy this timely article here:

      http://statisticalideas.blogspot.com/2015/02/volatility-product-proselytizers.html

      Delete
    2. Thanks; and revisited by popular demand: http://statisticalideas.blogspot.com/2016/04/defeated-managers-in-assets-globally.html OR https://twitter.com/salilstatistics/status/719718670805676033

      Delete
  3. Another "Anonymous" here:

    Have you tried separating the managers out into expense ratio quartiles (or even just two groups with a simple 1.0% breakpoint)? My read on the active manager problem is that it has two separate and what should be independent factors: expenses; and competence. We don't live in a frictionless world even though the indices indicate it should be so (although Vanguard does appear to regularly overcomes much of the friction in their large cap index funds).

    So a decile to quartile of the active funds generally do better than the indices over long periods of time. I have seen very little over the years to indicate whether or not lower expense ratios are a primary cause of that or manager competence. I suspect expense ratios are probably the stronger factor, but I don't believe I have seen conclusive proof of that.

    ReplyDelete
    Replies
    1. Thanks anonymous! In this case it doesn't matter. Please see the New York Times article given in the article. The returns were rigorously studied both pre and post expenses, and even in the former case most managers underperformed the benchmark. Skills brought in by single managers rarely leads to positive alpha over the long-run.

      Also see enjoy these highly praised articles, here:
      http://statisticalideas.blogspot.com/2014/02/forever-elusive-alpha.html
      http://statisticalideas.blogspot.com/2015/02/momentum-v-mean-reversion.html

      Delete
    2. Salil,
      I hope that you are still reading your blog. The topic of "majority of active managers grossly underperforming their benchmarks" has been chewed out and well publicized. What people fail to discuss, is that what about those few (rather 25%) who DO NOT under-perform?
      When I hire for my business, I do not seek out mediocrity. I research the background of my candidates, interview them, and higher the best. I pay them MORE than average (or median) salaries. Why not focus on superior active managers? Why not perform a comprehensive statistical analysis to help investors locate such consistent stars? They do exist. And creating a statistical tool to find such superior active managers is far more useful to general public than the NY Times (and Vanguard) rant that it is difficult to outperform an index.

      Delete
    3. Hi Anonymous, so your suggestions of the "consistent superior active manager" has been contradicted often by a number of researchers, so there is not much for me to comment on in support of that. In fact there will be more articles to hit the pipeline supporting my point of view in this way. Now as a general commentary, at some point we see enough mediocrity (as in average) in investment performances that it makes sense that people stop seeking an explanation for what happens "at some later point". Warren Buffett has exchanged with some of these blog ideas posted in the New York Times, and if you recall from his current annual letter he has directed his trustees to invest the vast majority of his fortune in the plain Vanguard 500.

      Please see the articles in my comment - just above your comment (April 18 5:35AM). It reflects ideas that are not incapsulated by the example you provided, concerning experiences with the typical operational employees in business.

      Delete
    4. Thanks; and revisited by popular demand: http://statisticalideas.blogspot.com/2016/04/defeated-managers-in-assets-globally.html OR https://twitter.com/salilstatistics/status/719718670805676033

      Delete
  4. Just FYI, if you enjoyed this article, then you might also enjoy my critical article in Pensions&Investments. It was the most popular article in this bi-weekly publication, read by leading endowment and pension advisers all over the globe!
    http://www.pionline.com/article/20150424/ONLINE/150429908/the-puzzle-in-active-investing

    ReplyDelete
  5. As valuable today as it was six months ago.

    ReplyDelete
    Replies
    1. Hi Drago, Thanks much for the comments. Please continue to read other articles on this site. Also, you may like this article:
      http://www.pionline.com/article/20150424/ONLINE/150429908/the-puzzle-in-active-investing

      Delete
    2. Thanks; and revisited by popular demand: http://statisticalideas.blogspot.com/2016/04/defeated-managers-in-assets-globally.html OR https://twitter.com/salilstatistics/status/719718670805676033

      Delete