Drilling Down on the TAA Model’s Real-time Performance

01May12

My personal trading is focused in two places right now: (a) trading volatility ETPs, and (b) tactical asset allocation (TAA).

My vol. trading is a big return generator today, but I recognize that I’m exploiting market imbalances that may not exist long-term.

On the other hand, TAA isn’t going to light the world on fire, but I can rest well knowing that we’re chasing opportunities that have existed for a century and more.

The TAA model has underperformed its benchmark in the 19 mos since inception.

As I’ve shown before, the model would historically have gone through long periods of underperforming, especially when the benchmark has been strong. This is a “generational” model, and I’m much more concerned with returns over the next decades than any one month or year.

But I think it’s still a worthwhile exercise to drill down on where the model has done well and not so well, and where it could be better.

Things the Model has Done Well

I’ve held U.S. Treasuries (IEF) and Gold (GLD) for most of the last 19 months. Those trades have done well – so well that ALL of the model’s returns since inception have come from just those two asset classes.

Things the Model has NOT Done Well

The model has done a poor job at both selecting specific equity asset classes to invest in AND timing the % of the portfolio to invest in equities each month.

Note that when I say equity asset classes I include real estate (VNQ) and commodities (GSG), because in today’s market, all are highly correlated.

To illustrate, in the graph below I’ve shown two portfolios. The first (grey) are the model’s actual “equity-driven” returns. The second (blue) are the results of simply investing in the volatility-adjusted equivalent of the S&P 500 (SPY) each month.

What I’m testing is the model’s success in picking specific equity asset classes (grey), versus just dumping each month’s equity exposure in to the S&P 500 (blue).


[growth of $1, linearly-scaled]

The fact that the grey line consistently trails the blue means that the model has done a bad job selecting equity asset classes.

A bit of that is due to bad luck (ex. taking a big position in EWJ right before the Tohoku earthquake), but most of it is bad timing.

But the suck doesn’t stop there.

Recall the blue line in the graph above, which is a different % of the portfolio invested in SPY each month. What if I just took the average exposure of all months, and invested it on day one. Here I’m testing the model’s success timing the % of the portfolio to invest in equities each month.


[growth of $1, linearly-scaled]

The fact that the blue line (slightly) trails the red means that the model has also done a bad job timing the % of the portfolio to invest in equities.

Next Steps

The first of these shortcomings (selecting the specific asset class) is an issue I need to continue analyzing. The model would have been better off just plowing equity exposure into the S&P 500 most months so far and that’s unacceptable.

The second shortcoming (timing the equity exposure) I chalk up to “stuff happens”. Like Mebane Faber (the inspiration for my own model) I’m using long-term moving averages to guide entry/exits in to equities, and that’s a concept that’s served investors well for a century plus (given enough time to let the averages play out).

I’m at my self-imposed word limit. More perhaps in a future post.

Happy Trading,
ms

. . . . .

To stay up to date with what’s happening at the MarketSci Blog, we recommend subscribing to our RSS Feed or Email Feed.



7 Responses to “Drilling Down on the TAA Model’s Real-time Performance”

  1. 1 Chris

    I know you state that trading costs should be minimal but can you give an indication of how the model performed so far inclusive of costs?

    Also, what sort of position sizing, if any, is used in the original analysis? Have you looked at the back test returns using fixed fraction or fixed ratio?

  2. 3 steve

    “analyze”=”optimize” and THAT is the basic problem with all quant analysis. the future does usually equal the past.

    • 4 MarketSci

      RE to Steve: shocking comment coming from a long-time reader.

      The aggregate performance of our programs (real-time, verifiable, sans cherry-picking) has solidly outperformed the market since 2006 in both absolute and risk-adjusted terms. We were able to accomplish that with ANALYSIS. Full stop.

      Yes, all analysis (including the anecdotal kind) is inherently curve fit to some degree, but “analysis” in and of itself isn’t a dirty word.

      michael

  3. 5 steve

    I stand by my comment.
    MOST quant analysis cherry picks winning strategies that by definition will not exist long going forward. the “trick” is to be deft in understanding and dealing with this quandary. I certainly meant no disrespect and quite possibly/probably you have mastered this to the extent that you can earn a living with quant trading. since 1995 I have made my living on a computer trading the markets and if I reported my average return you and others would think it BS but I cringe when I even sniff data mining. the trick is to find inefficient anomalies. not easy and getting more difficult every day.

  4. 7 MarketSci

    Just closing the loop on this post…

    After running the numbers, I’m chalking the first “shortcoming” of the model’s out-of-sample performance (i.e. doing a bad job selecting specific equity asset classes) up to “stuff happens” as well.

    Everything is within normal ranges seen in historical tests.

    If I might beat my drum one more time: this illustrates why it’s important not to get starry eyed when viewing long backtests. From 30,000 feet up you miss all the drawdowns and bad spots that make actual trading so difficult.

    Read more: http://marketsci.wordpress.com/2010/10/25/long-backtests-and-madoff%e2%80%99esque-returns/

    michael


Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Connecting to %s