Quantopian's community platform is shutting down. Please read this post for more information and download your code.
Back to Community
Regime change: A discussion and information sharing

Hi Q community

I have been giving some thought to the whole concept of regime change, change of market dynamics or you might call it "why does what used to work not work anymore?" The point of this post is to open a discussion of this phenomenon and possibly share research (either your own or others) and ask questions and openly think about how to profit from it, if possible.

There are different kind of regimes: E.g. the regime of bull market or bear market, or economic expansion or recession. The latter two are widely correlated with certain moves in stocks (up and down), but economists usually see the correlation post factum, which for a practitioner or algorithm creator is useless at best, and dangerous at worst as it can lead to overfitting.

Market pundits often speak of the market being in a "momentum" regime or a "mean reverting" regime, but also regarding fundamental data can the market be in a regime that favors value stocks (however you may define that) or growth stocks and a whole host of other different regimes. Just as with the economists knowing that stocks go down in a recession (ironic bravo) the market pundits may know that a certain market have favored certain factors for a while, which leads me to a few questions:

Do you think that:
1) It's possible to predict or at least diagnose what kind of market regime we'll be in or are currently in?
2) If possible, how do you measure it, i.e. what kind of tools would you use?
3) How do you avoid overfitting, in the case let's say you can predict a recession is coming, but who knows if it will be like the last one(e.g. especially finance stocks going to the dumps)?

For some more information see this which I have nothing to with and only found a little while ago from a quick google search.
Let me know what you think on this so important and difficult subject.

Jade Horse

3 responses

Thanks for the paper. See private email. Tony

Here's an idea to define market regimes based on general market (e.g. SPY) trend and volatility.
I attribute the idea to Cesar Alvarez, though I can't find the specific link.

The indicators and/or parameters can be changed but to avoid over-fitting I would stick with something generic.
I think the important idea is to test how your algorithm performs in different regimes and decide if you want to avoid trading during unfavorable times.

Hi @Steve,
This idea of using overall market Regime as a Filter is quite well-known and documented in a number of books. I can go through my bookcase to look for for examples if anyone is really interested enough, but basically Steve's example looks typical. Parameters values can be modified, but certainly the general consensus seems to be that using "Low-to-Medium Volatility, Bull Market" as a trade entry filter works well for Long-only equity systems.

The question then becomes how best to extend this idea to Quantopian-type market-neutral "Equity LongShort" algos where we need to balance Long & Short positions. Anyone who has studied market Regimes based on the combination of a) Trend direction / steepness of slope, or equivalent e.g. MACD or % above/below MA, or similar, and b) Volatility, knows that the partitioning between Up/Down, Steep/Gentle slope, High/Low volatility is not symmetrical and that, at least in equities (although not necessarily in commodities) markets, higher volatility seems to be generally associated with down-trends rather than up-trends.

I have attempted to use volatility not only as a filter, but also as a basis for selecting Long vs Short candidates (along with a lot of other factors), but i have not found the direction / slope / volatilitility combination to be as useful in EquityLS as in Long-only strategies. Perhaps someone else has had more success? If so then i would love to hear about it and discuss further. Cheers, T.