Feature
Understanding
Market Type Part IV
by
Van K.
Tharp, Ph.D.
When you have a trading system, you should always know how it performs under various market conditions. Previously, I’ve written about the direction of the market; however, in this article I’m going to focus on volatility as measured by the
ATR.
I was recently asked, “Doesn’t the daily percent change work as measure of volatility?” No, it doesn’t because the market could go from 810 to 870 and close at 811. The change would be minimal compared to the overall daily range. That’s why we use the average true range, which also takes into account any opening gaps.
Again, my market consists of the S&P 500 index, and I have data for that index going back to 1950 (i.e., over 14,000 days). My overall measure of volatility is the 20 day ATR. However, the ATR depends on the price:
The higher the price of the index, the bigger the ATR will be. Thus, we must use ATR as a percent of the close. This is illustrated in the table below.
Time
Frame |
Price |
20
Day ATR |
ATR
% Close |
|
Range |
Mean |
St
Dev |
Range |
Mean |
St
Dev |
Range |
Mean |
St
Dev |
2000-09 |
1565.1
to 676.5 |
1195.9 |
199.46 |
70.46
to 8.11 |
18.23 |
9.15 |
8.04
to 0.63 |
1.6 |
0.98 |
1990-99 |
1469.2
to 295.5 |
653.3 |
321.18 |
30.03
to 2.18 |
7.88 |
6.46 |
3.17
to 0.47 |
1.1 |
0.43 |
1980-89 |
359.8
to 98.22 |
198.61 |
72.08 |
14.31
to 0.94 |
2.57 |
1.37 |
5.99
to 0.56 |
1.37 |
0.65 |
1970-79 |
120.24
to 62.28 |
96.61 |
10.73 |
3.04
to 0.77 |
1.73 |
0.34 |
3.8
to 0.75 |
1.83 |
0.5 |
1969-60 |
108.37
to 52.2 |
79.51 |
14.9 |
2.11
to 0.13 |
1.09 |
0.52 |
3.58
to 0.22 |
1.32 |
0.55 |
1959-50 |
60.71
to 16.68 |
35.82 |
12.59 |
0.59
to 0.05 |
0.19 |
0.09 |
1.52
to 0.23 |
0.52 |
0.19 |
|
|
|
|
|
5.18 |
7.7 |
|
1.3 |
0.72 |
This table shows the ranges of price, 20 day ATR, and ATR % of close over the last six decades. Notice that the mean
ATR % does not change that much from decade to decade. The overall mean ATR % close is 1.3 with a standard deviation of 0.72.
After going through the extreme volatility of 2008-9, I’ve begun to suspect that such markets are extreme and generally only occur in extreme bearish conditions such as we’ve recently had and had in the 1930s. Data of the Dow Jones index, which goes back that far, suggest that this is indeed the case.
Anyway, I decided to sort the market types into four volatility groupings:
-
Normal: The average ATR% plus or minus 0.5 standard deviations.
-
Quiet: Anything less than a 0.5 standard deviation below the mean.
-
Volatile: 0.5 standard deviations to three standard deviations above the mean.
-
Very Volatile: Anything above three standard deviations from the mean.
The following table shows the distribution of our 14,755 days in these four categories.
Very
Volatile |
Volatile |
Normal |
Quiet |
Total
Days |
165 |
3,676 |
5,781 |
5,122 |
14,744 |
1.10% |
24.90% |
39.20% |
34.70% |
100.00% |
Notice that very volatile markets are rare, occurring only about 1% of the time. Volatile markets occur about 25% of the time. Normal markets occur almost
40% of the time, while quiet markets occur about 35% of the time.
The next table shows the average percent change in the S&P 500 during each of the four volatility-based market types.
Average
% Change |
Very
Volatile |
Volatile |
Normal |
Quiet |
-0.12% |
-0.01% |
0.04% |
0.05% |
Notice that the more volatile the market, the more likely the price is to go down. Similarly, the more quiet the market, the more likely the price is to go up (with both normal and quiet days being generally up days).
Let’s look at what happens to the market the next day after a given market classification. Here we are asking the question, “If the markets are highly volatile on March 3rd, what is the average
percent gain on the following day (i.e., March 4th) regardless of the market type that day?” This data is shown in the next table.
%
Change Next Day |
Very
Volatile |
Volatile |
Normal |
Quiet |
0.25% |
0.01% |
0.03% |
0.04% |
Notice that as you move from volatile to quiet, the expected percent change the next day goes up. However, the largest expected percent change is in very volatile markets. And here the expected percent gain is not down (as it is during such markets), it is up. This leads me to two assumptions:
-
As markets get volatile, they are more likely to be down markets.
-
In the markets that follow very volatile markets the next day (even though much of the time the next day will still be the same market type), the average change is the largest percentage gain from any type of market.
Combining Volatility and Direction to Describe Market Type
Now let’s combine our five market types (defined last week) with our four volatility types and see what we can expect. In this case we are using the 100 day SQN™ on the daily percent change to determine market direction.
|
Very
Volatile |
Volatile |
Normal |
Quiet |
Total |
Strong
Bull |
0 |
2.77% |
7.98% |
8.64% |
19.39% |
Bull |
0 |
5.34% |
16.60% |
16.07% |
38.02% |
Neutral |
0.03% |
5.24% |
7.77% |
5.89% |
18.94% |
Bear |
0.50% |
6.92% |
5.47% |
3.24% |
16.13% |
Strong
Bear |
0.58% |
4.65% |
1.40% |
0.90% |
7.53% |
|
1.12% |
24.93% |
39.21% |
34.74% |
100% |
The data in this table confirm what we were suspecting from the percentage change data: Very volatile days only occur during bear and strong bear markets. Although the percent of days shows up as zero, there was one
very volatile strong bull day. Thus every cell has at least one data point. On the other hand, bull and strong bull markets tend to be normal or quiet. 85.7% of the strong bull markets occur during normal or quiet conditions and 85.9% of bull markets occur during such conditions. 72.1% of neutral markets occur in normal and quiet conditions. However, when we move to bear and strong bear markets, the situation reverses. 54% of bear markets occur during normal and quiet conditions and only 30.5% of strong bear markets occur under such conditions, despite volatile and very volatile markets being somewhat infrequent.
Let’s look at our total market type and the average percentage gain/loss that is likely to occur under each market type condition. This is shown in the next table. There are no real surprises here.
|
Very
Volatile |
Volatile |
Normal |
Quiet |
Strong
Bull |
0.00% |
0.15% |
0.15% |
0.14% |
Bull |
0.00% |
0.06% |
0.05% |
0.07% |
Neutral |
1.37% |
0.13% |
0.00% |
-0.01% |
Bear |
0.15% |
-0.04% |
-0.08% |
-0.08% |
Strong
Bear |
-0.44% |
-0.27% |
-0.11% |
-0.13% |
Now let’s look at what happens the next day after a particular market type (the type might stay the same or it might not). In other words, if March 3rd is a volatile strong bull market, what is the likely percent change on March 4th (regardless of market type)? These data are shown in the next table.
Average Change
% Day After |
|
Very
Volatile |
Volatile |
Normal |
Quiet |
Strong
Bull |
0.62% |
0.03% |
0.05% |
0.04% |
Bull |
0.08% |
0.09% |
0.01% |
0.04% |
Neutral |
-0.05% |
0.03% |
0.05% |
0.03% |
Bear |
0.01% |
0.01% |
-0.01% |
0.05% |
Strong
Bear |
0.87% |
-0.05% |
-0.03% |
-0.03% |
When the market is bullish, we can expect the next day to be up. And when the market is strongly bearish, except for one condition, we can expect the market to be down. However, that condition (very
volatile strong bear) is one in which the average gain the next day can average nearly 1%.
Some History
Finally, let’s look at some history with our new market type. The next table shows market type for 2009 based upon our new classification. It still isn’t perfect. June is showing up as bullish, despite the very toppy looking market. But remember, we are still using a long period in our definition of market type (i.e., 100 days). The 25 day SQN is also shown as a reference. I’ve highlighted the high and low points in the bear market in 2009 for both the 100 and 25 days’ SQNs. Our market type is determined by the 100 day, but we will be watching the 25 day closely.
Date |
Volatility |
Direction |
SQN
100 |
ATR%
of Close |
SQN
25 |
6/19/2009 |
Volatile |
Bull |
0.5 |
1.94 |
0.48 |
6/18/2009 |
Volatile |
Bull |
0.53 |
2.02 |
0.58 |
6/17/2009 |
Volatile |
Bull |
0.52 |
2.08 |
0.07 |
6/16/2009 |
Volatile |
Bull |
0.55 |
2.06 |
0.08 |
6/15/2009 |
Volatile |
Bull |
0.54 |
2.09 |
-0.04 |
6/12/2009 |
Volatile |
Bull |
0.83 |
2 |
0.58 |
6/11/2009 |
Volatile |
Bull |
0.57 |
2.03 |
0.38 |
6/10/2009 |
Volatile |
Bull |
0.58 |
2.09 |
0.52 |
6/9/2009 |
Volatile |
Bull |
0.6 |
2.06 |
0.51 |
6/8/2009 |
Volatile |
Bull |
0.43 |
2.12 |
0.83 |
6/5/2009 |
Volatile |
Bull |
0.45 |
2.14 |
0.9 |
6/4/2009 |
Volatile |
Bull |
0.36 |
2.19 |
0.92 |
6/3/2009 |
Volatile |
Neutral |
0.22 |
2.23 |
1.02 |
6/2/2009 |
Volatile |
Neutral |
0.29 |
2.15 |
1.17 |
6/1/2009 |
Volatile |
Neutral |
0.15 |
2.25 |
1.01 |
5/29/2009 |
Volatile |
Neutral |
0.08 |
2.23 |
0.93 |
5/28/2009 |
Volatile |
Neutral |
0 |
2.28 |
0.89 |
5/27/2009 |
Volatile |
Neutral |
0.07 |
2.35 |
0.62 |
5/26/2009 |
Volatile |
Neutral |
0.21 |
2.28 |
1.11 |
5/22/2009 |
Volatile |
Neutral |
0.2 |
2.25 |
0.26 |
5/21/2009 |
Volatile |
Neutral |
0.19 |
2.28 |
0.33 |
5/20/2009 |
Volatile |
Neutral |
0.29 |
2.21 |
0.69 |
5/19/2009 |
Volatile |
Bull |
0.33 |
2.19 |
0.88 |
5/18/2009 |
Volatile |
Neutral |
0.3 |
2.25 |
0.66 |
5/15/2009 |
Volatile |
Neutral |
0.09 |
2.37 |
0.38 |
5/14/2009 |
Volatile |
Neutral |
0.15 |
2.33 |
0.87 |
5/13/2009 |
Volatile |
Neutral |
0.02 |
2.4 |
0.89 |
5/12/2009 |
Volatile |
Neutral |
0.09 |
2.29 |
0.93 |
5/11/2009 |
Volatile |
Bull |
0.31 |
2.28 |
0.84 |
5/8/2009 |
Volatile |
Bull |
0.35 |
2.22 |
1.21 |
5/7/2009 |
Volatile |
Neutral |
0.28 |
2.33 |
1.25 |
5/6/2009 |
Volatile |
Neutral |
0.21 |
2.21 |
1.59 |
5/5/2009 |
Volatile |
Neutral |
0.19 |
2.28 |
1.55 |
5/4/2009 |
Volatile |
Neutral |
0.11 |
2.32 |
1.11 |
5/1/2009 |
Volatile |
Neutral |
0.13 |
2.32 |
0.58 |
4/30/2009 |
Volatile |
Neutral |
0.25 |
2.44 |
0.75 |
4/29/2009 |
Volatile |
Neutral |
0.13 |
2.5 |
0.85 |
4/28/2009 |
Volatile |
Neutral |
0.15 |
2.53 |
0.43 |
4/27/2009 |
Volatile |
Bull |
0.32 |
2.63 |
0.96 |
4/24/2009 |
Volatile |
Neutral |
0 |
2.64 |
0.86 |
4/23/2009 |
Volatile |
Neutral |
-0.02 |
2.68 |
0.62 |
4/22/2009 |
Volatile |
Neutral |
0.07 |
2.81 |
0.7 |
4/21/2009 |
Volatile |
Neutral |
0.12 |
2.77 |
1 |
4/20/2009 |
Volatile |
Neutral |
0.28 |
3.02 |
0.81 |
4/17/2009 |
Volatile |
Bull |
0.66 |
2.81 |
1.31 |
4/16/2009 |
Volatile |
Bull |
0.39 |
2.86 |
1.55 |
4/15/2009 |
Volatile |
Neutral |
0.12 |
2.99 |
1.44 |
4/14/2009 |
Volatile |
Neutral |
0.11 |
3.09 |
1.69 |
4/13/2009 |
Volatile |
Neutral |
0.09 |
3.04 |
1.79 |
4/9/2009 |
Volatile |
Neutral |
-0.06 |
3.03 |
1.78 |
4/8/2009 |
Volatile |
Neutral |
0.04 |
3.18 |
1.12 |
4/7/2009 |
Volatile |
Neutral |
-0.17 |
3.25 |
1.2 |
4/6/2009 |
Volatile |
Neutral |
-0.16 |
3.3 |
1.35 |
4/3/2009 |
Volatile |
Neutral |
-0.18 |
3.29 |
1 |
4/2/2009 |
Volatile |
Neutral |
-0.11 |
3.42 |
0.76 |
4/1/2009 |
Very
Volatile |
Bear |
-0.37 |
3.52 |
0.47 |
3/31/2009 |
Very
Volatile |
Bear |
-0.59 |
3.57 |
0.28 |
3/30/2009 |
Very
Volatile |
Bear |
-0.49 |
3.59 |
0.45 |
3/27/2009 |
Volatile |
Bear |
-0.39 |
3.46 |
0.45 |
3/26/2009 |
Volatile |
Neutral |
-0.28 |
3.38 |
0.51 |
3/25/2009 |
Very
Volatile |
Neutral |
-0.27 |
3.52 |
0.28 |
3/24/2009 |
Very
Volatile |
Bear |
-0.34 |
3.5 |
0.21 |
3/23/2009 |
Very
Volatile |
Neutral |
0.07 |
3.51 |
0.04 |
3/20/2009 |
Very
Volatile |
Neutral |
-0.25 |
3.64 |
-0.53 |
3/19/2009 |
Very
Volatile |
Neutral |
-0.29 |
3.58 |
-0.38 |
3/18/2009 |
Very
Volatile |
Neutral |
-0.21 |
3.52 |
-0.23 |
3/17/2009 |
Volatile |
Bear |
-0.46 |
3.46 |
-0.71 |
3/16/2009 |
Very
Volatile |
Bear |
-0.65 |
3.63 |
-0.95 |
3/13/2009 |
Very
Volatile |
Bear |
-0.49 |
3.57 |
-0.71 |
3/12/2009 |
Very
Volatile |
Bear |
-0.53 |
3.68 |
-0.65 |
3/11/2009 |
Very
Volatile |
Bear |
-0.52 |
3.68 |
-1.04 |
3/10/2009 |
Very
Volatile |
Bear |
-0.77 |
3.89 |
-0.93 |
3/9/2009 |
Very
Volatile |
Bear |
-0.99 |
3.91 |
-1.64 |
3/6/2009 |
Very
Volatile |
Bear |
-0.59 |
3.9 |
-1.73 |
3/5/2009 |
Very
Volatile |
Bear |
-0.62 |
3.89 |
-1.99 |
3/4/2009 |
Very
Volatile |
Bear |
-0.7 |
3.64 |
-1.33 |
3/3/2009 |
Very
Volatile |
Bear |
-0.8 |
3.67 |
-1.47 |
3/2/2009 |
Very
Volatile |
Bear |
-0.93 |
3.64 |
-1.36 |
2/27/2009 |
Volatile |
Bear |
-0.91 |
3.43 |
-0.99 |
2/26/2009 |
Volatile |
Bear |
-0.89 |
3.43 |
-0.92 |
2/25/2009 |
Volatile |
Bear |
-0.95 |
3.4 |
-0.36 |
2/24/2009 |
Volatile |
Bear |
-0.93 |
3.29 |
-0.66 |
2/23/2009 |
Volatile |
Bear |
-0.89 |
3.37 |
-0.96 |
2/20/2009 |
Volatile |
Strong
Bear |
-1.01 |
3.23 |
-0.69 |
2/19/2009 |
Volatile |
Bear |
-0.97 |
3.22 |
-0.85 |
2/18/2009 |
Volatile |
Bear |
-0.89 |
3.29 |
-0.74 |
2/17/2009 |
Very
Volatile |
Bear |
-0.89 |
3.48 |
-0.9 |
2/13/2009 |
Volatile |
Bear |
-0.82 |
3.26 |
-0.75 |
2/12/2009 |
Volatile |
Bear |
-0.89 |
3.35 |
-0.63 |
2/11/2009 |
Volatile |
Bear |
-0.78 |
3.4 |
-0.88 |
2/10/2009 |
Volatile |
Bear |
-0.68 |
3.42 |
-0.88 |
2/9/2009 |
Volatile |
Bear |
-0.68 |
3.13 |
-0.56 |
2/6/2009 |
Volatile |
Bear |
-0.64 |
3.2 |
-0.28 |
2/5/2009 |
Volatile |
Bear |
-0.83 |
3.21 |
-0.39 |
2/4/2009 |
Volatile |
Bear |
-0.86 |
3.27 |
-0.32 |
2/3/2009 |
Volatile |
Bear |
-0.81 |
3.21 |
-0.29 |
2/2/2009 |
Volatile |
Bear |
-0.83 |
3.24 |
-0.38 |
1/30/2009 |
Volatile |
Bear |
-0.92 |
3.35 |
-0.33 |
1/29/2009 |
Volatile |
Bear |
-0.8 |
3.21 |
-0.22 |
1/28/2009 |
Volatile |
Bear |
-0.71 |
3.06 |
-0.09 |
1/27/2009 |
Volatile |
Bear |
-0.88 |
3.07 |
-0.39 |
1/26/2009 |
Volatile |
Bear |
-0.91 |
3.06 |
-0.69 |
1/23/2009 |
Volatile |
Bear |
-0.94 |
2.98 |
-0.83 |
1/22/2009 |
Volatile |
Bear |
-0.99 |
2.92 |
-0.35 |
1/21/2009 |
Volatile |
Bear |
-0.91 |
2.89 |
-0.33 |
1/20/2009 |
Volatile |
Strong
Bear |
-1.01 |
2.92 |
-0.69 |
1/16/2009 |
Volatile |
Bear |
-0.87 |
2.69 |
-0.52 |
1/15/2009 |
Volatile |
Bear |
-0.94 |
2.69 |
-0.47 |
1/14/2009 |
Volatile |
Bear |
-0.91 |
2.76 |
-0.7 |
1/13/2009 |
Volatile |
Bear |
-0.82 |
2.62 |
0 |
1/12/2009 |
Volatile |
Bear |
-0.81 |
2.72 |
0.32 |
1/9/2009 |
Volatile |
Bear |
-0.77 |
2.72 |
0.25 |
1/8/2009 |
Volatile |
Bear |
-0.76 |
2.65 |
0.67 |
1/7/2009 |
Volatile |
Bear |
-0.75 |
2.76 |
0.94 |
1/6/2009 |
Volatile |
Bear |
-0.66 |
2.73 |
0.36 |
1/5/2009 |
Volatile |
Bear |
-0.69 |
2.99 |
0.37 |
1/2/2009 |
Volatile |
Bear |
-0.71 |
3.11 |
0.62 |
We will use this new market type
classification in our monthly updates from here on. These articles on market type will only be available in our newsletter for the next two weeks. After that point they will be available only as a special report until they are reprinted in the 2nd edition
of
The Definitive Guide to Position Sizing™.
All of this work was done with the XLQ add on to Excel with the help of Leo van Rijswijk, the developer of XLQ.
About
Van Tharp: Trading coach, and author, Dr. Van K. Tharp is
widely recognized for his best-selling books and his outstanding
Peak Performance Home Study program - a highly regarded classic
that is suitable for all levels of traders and investors. You can
learn more about Van Tharp at www.iitm.com.
|