Home Workshops Products Contact Us

View this newsletter on-line, or read back issues

   

Tharp's Thoughts Weekly Newsletter (View On-Line)

June 24, 2009 - Issue #429

-

Workshops

Learn Six Winning ETF Strategies

Article

Understanding Market Type Part IV by Van K. Tharp Ph.D.

Trading Education

The Definitive Guide to Position Sizing

Trading Tip

Cutting Off the Left Side of the Bell Curve Part III by D.R. Barton, Jr.

Ask Van

Expectancy

 

Feature

Understanding Market Type Part IV

by

Van K. Tharp, Ph.D.

When you have a trading system, you should always know how it performs under various market conditions. Previously, I’ve written about the direction of the market; however, in this article I’m going to focus on volatility as measured by the ATR.

I was recently asked, “Doesn’t the daily percent change work as measure of volatility?” No, it doesn’t because the market could go from 810 to 870 and close at 811. The change would be minimal compared to the overall daily range. That’s why we use the average true range, which also takes into account any opening gaps.

Again, my market consists of the S&P 500 index, and I have data for that index going back to 1950 (i.e., over 14,000 days). My overall measure of volatility is the 20 day ATR. However, the ATR depends on the price: The higher the price of the index, the bigger the ATR will be. Thus, we must use ATR as a percent of the close. This is illustrated in the table below.

 Time Frame Price 20 Day ATR ATR % Close
Range Mean St Dev Range Mean St Dev Range Mean St Dev
2000-09 1565.1 to 676.5 1195.9 199.46 70.46 to 8.11 18.23 9.15 8.04 to 0.63 1.6 0.98
1990-99 1469.2 to 295.5 653.3 321.18 30.03 to 2.18 7.88 6.46 3.17 to 0.47 1.1 0.43
1980-89 359.8 to 98.22 198.61 72.08 14.31 to 0.94 2.57 1.37 5.99 to 0.56 1.37 0.65
1970-79 120.24 to 62.28 96.61 10.73 3.04 to 0.77 1.73 0.34 3.8 to 0.75 1.83 0.5
1969-60 108.37 to 52.2 79.51 14.9 2.11 to 0.13 1.09 0.52 3.58 to 0.22 1.32 0.55
1959-50 60.71 to 16.68 35.82 12.59 0.59 to 0.05 0.19 0.09 1.52 to 0.23 0.52 0.19
          5.18 7.7   1.3 0.72

This table shows the ranges of price, 20 day ATR, and ATR % of close over the last six decades. Notice that the mean ATR % does not change that much from decade to decade. The overall mean ATR % close is 1.3 with a standard deviation of 0.72.

After going through the extreme volatility of 2008-9, I’ve begun to suspect that such markets are extreme and generally only occur in extreme bearish conditions such as we’ve recently had and had in the 1930s. Data of the Dow Jones index, which goes back that far, suggest that this is indeed the case.

Anyway, I decided to sort the market types into four volatility groupings: 

  • Normal: The average ATR% plus or minus 0.5 standard deviations. 

  • Quiet: Anything less than a 0.5 standard deviation below the mean.
     

  • Volatile: 0.5 standard deviations to three standard deviations above the mean.
     

  • Very Volatile: Anything above three standard deviations from the mean.

The following table shows the distribution of our 14,755 days in these four categories.

Very Volatile Volatile Normal Quiet Total Days
165 3,676 5,781 5,122 14,744
1.10% 24.90% 39.20% 34.70% 100.00%

Notice that very volatile markets are rare, occurring only about 1% of the time. Volatile markets occur about 25% of the time. Normal markets occur almost 40% of the time, while quiet markets occur about 35% of the time. 

The next table shows the average percent change in the S&P 500 during each of the four volatility-based market types.

Average % Change
Very Volatile Volatile Normal Quiet
-0.12% -0.01% 0.04% 0.05%

Notice that the more volatile the market, the more likely the price is to go down. Similarly, the more quiet the market, the more likely the price is to go up (with both normal and quiet days being generally up days).

Let’s look at what happens to the market the next day after a given market classification. Here we are asking the question, “If the markets are highly volatile on March 3rd, what is the average percent gain on the following day (i.e., March 4th) regardless of the market type that day?” This data is shown in the next table.

% Change Next Day
Very Volatile Volatile Normal Quiet
0.25% 0.01% 0.03% 0.04%

Notice that as you move from volatile to quiet, the expected percent change the next day goes up. However, the largest expected percent change is in very volatile markets. And here the expected percent gain is not down (as it is during such markets), it is up. This leads me to two assumptions:

  1. As markets get volatile, they are more likely to be down markets.

  2. In the markets that follow very volatile markets the next day (even though much of the time the next day will still be the same market type), the average change is the largest percentage gain from any type of market.

Combining Volatility and Direction to Describe Market Type

Now let’s combine our five market types (defined last week) with our four volatility types and see what we can expect. In this case we are using the 100 day SQN™ on the daily percent change to determine market direction.

  Very Volatile Volatile Normal Quiet Total
Strong Bull 0 2.77% 7.98% 8.64% 19.39%
Bull 0 5.34% 16.60% 16.07% 38.02%
Neutral 0.03% 5.24% 7.77% 5.89% 18.94%
Bear 0.50% 6.92% 5.47% 3.24% 16.13%
Strong Bear 0.58% 4.65% 1.40% 0.90% 7.53%
  1.12% 24.93% 39.21% 34.74% 100%

The data in this table confirm what we were suspecting from the percentage change data: Very volatile days only occur during bear and strong bear markets. Although the percent of days shows up as zero, there was one very volatile strong bull day. Thus every cell has at least one data point. On the other hand, bull and strong bull markets tend to be normal or quiet. 85.7% of the strong bull markets occur during normal or quiet conditions and 85.9% of bull markets occur during such conditions. 72.1% of neutral markets occur in normal and quiet conditions. However, when we move to bear and strong bear markets, the situation reverses. 54% of bear markets occur during normal and quiet conditions and only 30.5% of strong bear markets occur under such conditions, despite volatile and very volatile markets being somewhat infrequent.

Let’s look at our total market type and the average percentage gain/loss that is likely to occur under each market type condition. This is shown in the next table. There are no real surprises here.

  Very Volatile Volatile Normal Quiet
Strong Bull 0.00% 0.15% 0.15% 0.14%
Bull 0.00% 0.06% 0.05% 0.07%
Neutral 1.37% 0.13% 0.00% -0.01%
Bear 0.15% -0.04% -0.08% -0.08%
Strong Bear -0.44% -0.27% -0.11% -0.13%

Now let’s look at what happens the next day after a particular market type (the type might stay the same or it might not). In other words, if March 3rd is a volatile strong bull market, what is the likely percent change on March 4th (regardless of market type)? These data are shown in the next table.

Average Change % Day After
  Very Volatile Volatile Normal Quiet
Strong Bull 0.62% 0.03% 0.05% 0.04%
Bull 0.08% 0.09% 0.01% 0.04%
Neutral -0.05% 0.03% 0.05% 0.03%
Bear 0.01% 0.01% -0.01% 0.05%
Strong Bear 0.87% -0.05% -0.03% -0.03%

When the market is bullish, we can expect the next day to be up. And when the market is strongly bearish, except for one condition, we can expect the market to be down. However, that condition (very volatile strong bear) is one in which the average gain the next day can average nearly 1%.

Some History

Finally, let’s look at some history with our new market type. The next table shows market type for 2009 based upon our new classification. It still isn’t perfect. June is showing up as bullish, despite the very toppy looking market. But remember, we are still using a long period in our definition of market type (i.e., 100 days). The 25 day SQN is also shown as a reference. I’ve highlighted the high and low points in the bear market in 2009 for both the 100 and 25 days’ SQNs. Our market type is determined by the 100 day, but we will be watching the 25 day closely.

Date Volatility Direction SQN 100 ATR% of Close SQN 25
6/19/2009 Volatile Bull 0.5 1.94 0.48
6/18/2009 Volatile Bull 0.53 2.02 0.58
6/17/2009 Volatile Bull 0.52 2.08 0.07
6/16/2009 Volatile Bull 0.55 2.06 0.08
6/15/2009 Volatile Bull 0.54 2.09 -0.04
6/12/2009 Volatile Bull 0.83 2 0.58
6/11/2009 Volatile Bull 0.57 2.03 0.38
6/10/2009 Volatile Bull 0.58 2.09 0.52
6/9/2009 Volatile Bull 0.6 2.06 0.51
6/8/2009 Volatile Bull 0.43 2.12 0.83
6/5/2009 Volatile Bull 0.45 2.14 0.9
6/4/2009 Volatile Bull 0.36 2.19 0.92
6/3/2009 Volatile Neutral 0.22 2.23 1.02
6/2/2009 Volatile Neutral 0.29 2.15 1.17
6/1/2009 Volatile Neutral 0.15 2.25 1.01
5/29/2009 Volatile Neutral 0.08 2.23 0.93
5/28/2009 Volatile Neutral 0 2.28 0.89
5/27/2009 Volatile Neutral 0.07 2.35 0.62
5/26/2009 Volatile Neutral 0.21 2.28 1.11
5/22/2009 Volatile Neutral 0.2 2.25 0.26
5/21/2009 Volatile Neutral 0.19 2.28 0.33
5/20/2009 Volatile Neutral 0.29 2.21 0.69
5/19/2009 Volatile Bull 0.33 2.19 0.88
5/18/2009 Volatile Neutral 0.3 2.25 0.66
5/15/2009 Volatile Neutral 0.09 2.37 0.38
5/14/2009 Volatile Neutral 0.15 2.33 0.87
5/13/2009 Volatile Neutral 0.02 2.4 0.89
5/12/2009 Volatile Neutral 0.09 2.29 0.93
5/11/2009 Volatile Bull 0.31 2.28 0.84
5/8/2009 Volatile Bull 0.35 2.22 1.21
5/7/2009 Volatile Neutral 0.28 2.33 1.25
5/6/2009 Volatile Neutral 0.21 2.21 1.59
5/5/2009 Volatile Neutral 0.19 2.28 1.55
5/4/2009 Volatile Neutral 0.11 2.32 1.11
5/1/2009 Volatile Neutral 0.13 2.32 0.58
4/30/2009 Volatile Neutral 0.25 2.44 0.75
4/29/2009 Volatile Neutral 0.13 2.5 0.85
4/28/2009 Volatile Neutral 0.15 2.53 0.43
4/27/2009 Volatile Bull 0.32 2.63 0.96
4/24/2009 Volatile Neutral 0 2.64 0.86
4/23/2009 Volatile Neutral -0.02 2.68 0.62
4/22/2009 Volatile Neutral 0.07 2.81 0.7
4/21/2009 Volatile Neutral 0.12 2.77 1
4/20/2009 Volatile Neutral 0.28 3.02 0.81
4/17/2009 Volatile Bull 0.66 2.81 1.31
4/16/2009 Volatile Bull 0.39 2.86 1.55
4/15/2009 Volatile Neutral 0.12 2.99 1.44
4/14/2009 Volatile Neutral 0.11 3.09 1.69
4/13/2009 Volatile Neutral 0.09 3.04 1.79
4/9/2009 Volatile Neutral -0.06 3.03 1.78
4/8/2009 Volatile Neutral 0.04 3.18 1.12
4/7/2009 Volatile Neutral -0.17 3.25 1.2
4/6/2009 Volatile Neutral -0.16 3.3 1.35
4/3/2009 Volatile Neutral -0.18 3.29 1
4/2/2009 Volatile Neutral -0.11 3.42 0.76
4/1/2009 Very Volatile Bear -0.37 3.52 0.47
3/31/2009 Very Volatile Bear -0.59 3.57 0.28
3/30/2009 Very Volatile Bear -0.49 3.59 0.45
3/27/2009 Volatile Bear -0.39 3.46 0.45
3/26/2009 Volatile Neutral -0.28 3.38 0.51
3/25/2009 Very Volatile Neutral -0.27 3.52 0.28
3/24/2009 Very Volatile Bear -0.34 3.5 0.21
3/23/2009 Very Volatile Neutral 0.07 3.51 0.04
3/20/2009 Very Volatile Neutral -0.25 3.64 -0.53
3/19/2009 Very Volatile Neutral -0.29 3.58 -0.38
3/18/2009 Very Volatile Neutral -0.21 3.52 -0.23
3/17/2009 Volatile Bear -0.46 3.46 -0.71
3/16/2009 Very Volatile Bear -0.65 3.63 -0.95
3/13/2009 Very Volatile Bear -0.49 3.57 -0.71
3/12/2009 Very Volatile Bear -0.53 3.68 -0.65
3/11/2009 Very Volatile Bear -0.52 3.68 -1.04
3/10/2009 Very Volatile Bear -0.77 3.89 -0.93
3/9/2009 Very Volatile Bear -0.99 3.91 -1.64
3/6/2009 Very Volatile Bear -0.59 3.9 -1.73
3/5/2009 Very Volatile Bear -0.62 3.89 -1.99
3/4/2009 Very Volatile Bear -0.7 3.64 -1.33
3/3/2009 Very Volatile Bear -0.8 3.67 -1.47
3/2/2009 Very Volatile Bear -0.93 3.64 -1.36
2/27/2009 Volatile Bear -0.91 3.43 -0.99
2/26/2009 Volatile Bear -0.89 3.43 -0.92
2/25/2009 Volatile Bear -0.95 3.4 -0.36
2/24/2009 Volatile Bear -0.93 3.29 -0.66
2/23/2009 Volatile Bear -0.89 3.37 -0.96
2/20/2009 Volatile Strong Bear -1.01 3.23 -0.69
2/19/2009 Volatile Bear -0.97 3.22 -0.85
2/18/2009 Volatile Bear -0.89 3.29 -0.74
2/17/2009 Very Volatile Bear -0.89 3.48 -0.9
2/13/2009 Volatile Bear -0.82 3.26 -0.75
2/12/2009 Volatile Bear -0.89 3.35 -0.63
2/11/2009 Volatile Bear -0.78 3.4 -0.88
2/10/2009 Volatile Bear -0.68 3.42 -0.88
2/9/2009 Volatile Bear -0.68 3.13 -0.56
2/6/2009 Volatile Bear -0.64 3.2 -0.28
2/5/2009 Volatile Bear -0.83 3.21 -0.39
2/4/2009 Volatile Bear -0.86 3.27 -0.32
2/3/2009 Volatile Bear -0.81 3.21 -0.29
2/2/2009 Volatile Bear -0.83 3.24 -0.38
1/30/2009 Volatile Bear -0.92 3.35 -0.33
1/29/2009 Volatile Bear -0.8 3.21 -0.22
1/28/2009 Volatile Bear -0.71 3.06 -0.09
1/27/2009 Volatile Bear -0.88 3.07 -0.39
1/26/2009 Volatile Bear -0.91 3.06 -0.69
1/23/2009 Volatile Bear -0.94 2.98 -0.83
1/22/2009 Volatile Bear -0.99 2.92 -0.35
1/21/2009 Volatile Bear -0.91 2.89 -0.33
1/20/2009 Volatile Strong Bear -1.01 2.92 -0.69
1/16/2009 Volatile Bear -0.87 2.69 -0.52
1/15/2009 Volatile Bear -0.94 2.69 -0.47
1/14/2009 Volatile Bear -0.91 2.76 -0.7
1/13/2009 Volatile Bear -0.82 2.62 0
1/12/2009 Volatile Bear -0.81 2.72 0.32
1/9/2009 Volatile Bear -0.77 2.72 0.25
1/8/2009 Volatile Bear -0.76 2.65 0.67
1/7/2009 Volatile Bear -0.75 2.76 0.94
1/6/2009 Volatile Bear -0.66 2.73 0.36
1/5/2009 Volatile Bear -0.69 2.99 0.37
1/2/2009 Volatile Bear -0.71 3.11 0.62

 We will use this new market type classification in our monthly updates from here on. These articles on market type will only be available in our newsletter for the next two weeks. After that point they will be available only as a special report until they are reprinted in the 2nd edition of The Definitive Guide to Position Sizing™.

All of this work was done with the XLQ add on to Excel with the help of Leo van Rijswijk, the developer of XLQ. 

About Van Tharp: Trading coach, and author, Dr. Van K. Tharp is widely recognized for his best-selling books and his outstanding Peak Performance Home Study program - a highly regarded classic that is suitable for all levels of traders and investors. You can learn more about Van Tharp at www.iitm.com. 

 

Trading Education

 Definitive Guide to Position Sizing

 Want to really understand Van's System Quality Number™? 

This book explains the details of SQN and how to use it to figure out if your trading systems are worthwhile, before you determine your position sizing.

 Learn More

Trading Tip

Cutting Off the Left Side of the Bell Curve Part III

by
D.R. Barton, Jr.

“People who don't take risks generally make about 2 big mistakes a year. People who do take risks generally make about 2 big mistakes a year.”
-- Peter Drucker

Imagine working on a project where you’re building something—let’s say a storage shed in the backyard.

You pour the concrete foundation, and then you start framing in the structure. Walls go up, and then you put in the rafters to support the roof. After a couple of weeks of good work, it really looks like you’re building something special.

Then one day, you make a mistake. And then another. And the whole structure comes tumbling down. Weeks of work destroyed in just a couple of poor moves.

While this seems somewhat silly, almost absurd, it is exactly what happens to many traders’ accounts.

They spend weeks or even months building up the equity in their accounts, only to give it all back in one or two bad trades or one or two poorly managed trading days.

For the last two articles, we’ve been talking about managing the left side of the equity curve: finding a way to minimize individual and cumulative losses.

Last week we looked at a bell curve and talked about knocking out those trades that make up the “tail” of the loss side of the bell curve—the big losing trades that end up being more than twice as big as originally planned. Van rightfully classifies all of these trades as “mental errors” (all that are not caused by overnight gaps, etc.).

Today we’re going to talk about those days (for intraday trades) or weeks (for swing and longer term traders) that eat up weeks or months of profits.

These are the days where a trader enters into a downward spiral of losses that seem to compound and grow with every trade. Not only are mental mistakes made, but they are increased as the trading period continues. Mistakes like these come in bunches:

  • Continually fighting a trend. When a trader tries to catch an exhaustion move or find a turning point in a strongly trending market. This can happen to day or swing traders. With each further extension of the trend, it seems like this has to be last gasp; surely this thing will turn around here! But losses mount, and without a way to break the cycle, they get worse and worse.
  • Competitive or revenge trading. In our e-mini bootcamp that we’re holding this week, we have found this to be a mental mistake that rings true with so many participants! Having a trade go against you and following it up with a low-quality trade just to “have a winner” or to “show the market who’s boss” can lead to a series of trades that are pure equity killers.
  • Any period when our trading strategy is not matched with the market (e.g., trend following in choppy markets, or counter-trend trading in trending markets). If our trading plan doesn’t have a good way to minimize trading in these periods (or stop trading all together), then trading losses can add up quickly.

Tools for Protecting and Managing the Left Side of the Equity Curve

Fortunately, we have some good tools at our disposal to manage these losing periods:

  • Good old fashioned stop losses.  Most people reading this article are familiar with the use of stop losses. But knowing about them and using them in an unwavering manner are two different things! And until one uses stops with unswerving discipline, then nothing else will make any difference. This is the foundation to managing the left side of the equity bell curve.
  • Understanding our trading systems and strategies.  The better we understand our strategies, the less likely we will be to trade or overtrade the strategy in a market where it performs poorly. I’ve often said in system design classes that I really like trading systems that have some self-regulating mechanisms in their designs that help them trade less often (or not at all) in unfavorable markets.
  • Using a “circuit breaker”.  Almost all traders can benefit from using some sort of loss circuit breaker—a rule that makes the trader shut down after a certain loss for the day, week or month. This idea alone can help traders to manage those tails at the far left of the equity bell curve.

Thanks to all of you who have sent in your stories of mistakes and managing the left side of your bell curve! I’ll summarize some your great ideas next week. Anyone who would like to submit stories can send them to drbarton “at” iitm.com. 

Until next week…Great Trading!

D. R. 

About D.R. Barton, Jr.:  A passion for the systematic approach to the markets and lifelong love of teaching and learning have propelled D.R. Barton, Jr. to the top of the investment and trading arena.  He is a regularly featured guest on both Report on Business TV, and WTOP News Radio in Washington, D.C., and has been a guest on Bloomberg Radio. His articles have appeared on SmartMoney.com and Financial Advisor magazine. You may contact D.R. at  "drbarton" at "iitm.com".  

Q&A

Expectancy

Q: I've read both Trade Your Way and your Electronic Day Trading book. If I have an R-multiple derived after system testing a number of trades, once actual trading commences, do I enter all trades, regardless of  average R, and use the stop indicated by my system, or simply not exceed the average R derived from the expectancy study? Lee Rousseau

A: Expectancy is the mean of the R-multiples. Half the samples you get in the future will be worse. Half will be better. You should always follow your system's stop. — Van

 

Feedback

Ask Van...

Everything that we do here at the Van Tharp Institute is to help you improve as a trader and investor. Therefore, we love to get your feedback, both positive and negative!

Feel free to click below to leave us any comments so that we can serve you better. Or, send Van a question that you would like for him to answer. 

Click Here for Feedback Form

 

Email us  [email protected]

The Van Tharp Institute does not support spamming in any way, shape or form. This is a subscription based newsletter.

To change your e-mail Address, click here

Or, paste this address in your browser: http://www.iitm.com/privacy_policy.htm

 The Van Tharp Institute
102-A Commonwealth Court, Cary, NC 27511 USA
800-385-4486 * 919-466-0043 *  Fax 919-466-0408

Back to top

Copyright 2009 the International Institute of Trading Mastery, Inc.

.

.

.

Quote:.

“When my attitudes are right, there is no barrier too high, no valley too deep, no dream too extreme, no challenge too great for me.” 
~ Charles R. Swindoll

...

.

.

.

.

.

Trouble viewing this issue?

  View On-line.

.

.

.

..


Buy Now

.

.

.

..

Back to top

.

..

.

.

.

Tharp Concepts Explained...

 

- Psychology of Trading

- System Development

- Risk and R-Multiples

- Position Sizing

- Expectancy

- Business Planning

Learn the concepts...

.

.

.

.

~

~~~~~

.Back to top

~

~

~

.

.

Free Downloads

Handbook for Traders and Investors

 

~

~

.

.

.

.

~~

~

Free Trading Simulation Game

A computerized version of Van's famous "marble game."

It is designed to teach you the important principles of proper position sizing.

Download the 1st three levels of the game for free. Register now.

~

.

.

~

~~~~~

.Back to top

..

.

.

.

~

.

.

Share this newsletter with a friend!

..

.

.

..Back to top

.

.

.

.

.

.

.

.

....

Share this newsletter with a friend!

~.~~~

~