Studies Show Indices Overstate Hedge Fund Performance

Mar 11 2011 | 12:38pm ET

Hedge fund journals everywhere—this one included—routinely rely on and trumpet hedge fund indices as accurate barometers of how the industry is performing. But a new study has revived concerns that indices are anything but an unvarnished look at hedge fund returns.

According to the Edhec-Risk Institute, hedge fund indices routinely overstate industry performance. The study reads, "the performance of multi-strategy indices whose portfolios included illiquid strategies was extraordinarily overstated after mid-2008."

"It is more and more difficult to justify the use of non-investable composite indices as benchmarks unless we can suggest a practical and easy-to-implement solution that could substantially reduce the biases that overstate their performance, especially in periods of market stress," Edhec head of applied research Felix Goltz told the Financial Times.

Just how much do indices overstate performance? By a lot, according to some players. Yale University Professor Roger Ibbotson and Peng Chen of Ibbotsen Associates found that the compound annual return of the Lipper Tass database was just 8.98%, compared to a reported 16.45%. Michael Azlen of Frontier Capital said his firm cuts single-manager index performance by 4% a year and fund of funds indices by 1%.

Indices are plagued by three types of biases, according to critics. End-of-life reporting bias occurs when a hedge fund in a death spiral simply stops reporting its growing losses to indices. Speaking of death spirals, indices are also accused of a survivorship bias, with indices showing the returns only of surviving—and presumably thriving—hedge funds and excluding the hundreds of hedge funds that fail every year, many of them due to poor performance. Finally, there is backfill bias, caused when an index allows a hedge fund to retroactively add its historic data after it begins reporting results.

A five-year-old study of the Lipper database, by Princeton University economist Burton Malkiel and Analysis Group's Atanu Saha, show that backfilled returns were an average of 500 basis points higher per year than returns reported live between 1994 and 2003. The same report showed that surviving hedge funds enjoyed returns that were 740 basis points higher than funds that did not survive. And Malkiel thinks things have gotten worse.

"There seems to me to be circumstantial evidence that the survivorship bias during the credit crisis was even larger," he told the FT. "There are still many biases in the data and published reports overstate returns, so what you see is not necessarily what you get."

One prominent index provider, Hedge Fund Research, defended the benchmarks. President Kenneth Heinz told the FT that his firm works hard "to mitigate the effects of those biases." Those efforts mean that HFR's indices avoid backfill and survivorship biases to a great extent.


In Depth

Part II: Roubini Talks Risk, Recovery And The Threat Of A Triple Dip Recession

Oct 21 2014 | 12:41pm ET

In the second half of our interview with Nouriel Roubini, FINalternatives editor...

Lifestyle

Balyasny Pays Over $6M For Lakefront House

Oct 22 2014 | 10:29am ET

A venture headed by hedge fund manager Dmitry Balyasny just paid $6.2 million for...

Guest Contributor

Hedge Funds Weather A Data Management Perfect Storm

Oct 22 2014 | 12:28pm ET

From a regulatory standpoint, nearly every development since the crisis has placed...

 

Videos

Editor's Note

    Guidelines for Guest Articles

    Oct 22 2014 | 9:46am ET

    We are always looking for guest articles from hedge fund managers and buy-side firms.

    If you are interested in submitting a contributed piece for possible publication on FINalternatives, please take a look at the specs. Read more…

 

Futures Magazine

October 2014 Cover

Deeply flawed risk benchmark

Most traders agree that proper risk management is the key to successful trading. However, many traders depend on the deeply flawed measure of standard deviation as a benchmark of risk. Here we put it ...

The Alpha Pages

TAP July/August 2014 Cover

The Alpha Pages Interview: Senator Rand Paul

Senator Paul sat down in the debut series of the Alpha Pages Interview to discuss the broken tax code, regulation surrounding Bitcoin, and his plans for the 2016 Presidential election.