<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Au.Tra.Sy blog - Automated trading System &#187; autocorrelation</title>
	<atom:link href="http://www.automated-trading-system.com/tag/autocorrelation/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.automated-trading-system.com</link>
	<description>Systematic Trading research and development, with a flavour of Trend Following</description>
	<lastBuildDate>Tue, 07 Feb 2012 09:58:33 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.3.1</generator>
		<item>
		<title>Intricacies of Market and Trend Following Changes</title>
		<link>http://www.automated-trading-system.com/intricacies-of-market-and-trend-following-changes/</link>
		<comments>http://www.automated-trading-system.com/intricacies-of-market-and-trend-following-changes/#comments</comments>
		<pubDate>Wed, 10 Mar 2010 11:10:49 +0000</pubDate>
		<dc:creator>Jez Liberty</dc:creator>
				<category><![CDATA[Strategies]]></category>
		<category><![CDATA[autocorrelation]]></category>
		<category><![CDATA[distribution]]></category>
		<category><![CDATA[kurtosis]]></category>
		<category><![CDATA[michael covel]]></category>
		<category><![CDATA[niederhoffer]]></category>
		<category><![CDATA[Turtle]]></category>
		<category><![CDATA[walk-forward]]></category>

		<guid isPermaLink="false">http://www.automated-trading-system.com/?p=1880</guid>
		<description><![CDATA[In the last post we looked at the Turtle Trading system and saw that its performance went from outstanding for a long period of time to flat for 20 years. This opens a can of worms: Does Trend Following work, is it dead, do markets change, does trend following rules need to adapt to these [...]]]></description>
			<content:encoded><![CDATA[<div id="attachment_1887" class="wp-caption aligncenter" style="width: 310px"><img src="http://www.automated-trading-system.com/wp-content/uploads/2010/03/nebulous-look1.jpg" alt="nebulous intricacies" title="nebulous look" width="300" height="215" class="size-full wp-image-1887" /><p class="wp-caption-text">nebulous intricacies</p></div>
<p>In the last post we looked at the <a href="http://www.automated-trading-system.com/turtles-just-lucky/">Turtle Trading system</a> and saw that its performance went from outstanding for a long period of time to flat for 20 years. This opens a can of worms:</p>
<p><em>Does Trend Following work, is it dead, do markets change, does trend following rules need to adapt to these changes?</em></p>
<p>Let&#8217;s look at the different points of view.<span id="more-1880"></span></p>
<h3>The EMH Crowd</h3>
<p>The EMH crowd does not believe in anything else than the <em>Random Walk</em> and by definition discards any profit-generating mechanical strategy.</p>
<p>As much as the <strong>Efficient Market Hypothesis</strong> (EMH) is a cornerstone of most modern financial theory, it has proven to be wrong partly because of some of its assumptions (not all actors in the market are rational, market prices are not fully random and normally distributed, etc.).</p>
<p>One great book that discredits the EMH approach and their <em>descendant</em> theories (CAPM, etc.) is by <strong>Mandelbrot</strong>: <a href="http://www.amazon.com/exec/obidos/ASIN/0465043577/autotradblog-20" target="_blank" rel="nofollow">The (mis)behavior of the markets</a>. It lays the arguments against the EMH in an approachable (ie not too much maths) way.</p>
<h3>Trend Following is dead/does not work</h3>
<p>Curtis Faith declared that &#8220;every few years trend following traders experience a period of losses and inevitably some expert will announce the end of trend following.&#8221;</p>
<p>Mike Covel also has a similar quote in his <a href="http://www.amazon.com/exec/obidos/ASIN/013702018X/autotradblog-20" target="_blank" rel="nofollow">Trend Following</a> book: &#8220;every 5 years some famous trader blows up and everyone declares <strong>trend following to be dead</strong>. Then 5 years later some famous trader blows up and everyone declares trend following to be dead, etc. &#8221;</p>
<p>One of the main proponents of the argument against Trend Following is infamous trader <strong>Vic Niederhoffer</strong> (who &#8220;blew up&#8221; twice). He has been highly vocal about it, declaring Trend Following as one of the <a href="http://www.dailyspeculations.com/vic/goodboy_interview.html" target="_blank" rel="nofollow">top Stock Market con</a>.<br />
Here is <a href="http://www.dailyspeculations.com/wordpress/?p=830" target="_blank" rel="nofollow">another link</a> from his website to read more about it.</p>
<p>Arguments like this, despite the empirical evidence against it &#8211; in the form of Trend Following Wizards success, can be taken as a motivation for healthy skepticism and push you to strengthen your statistical research.</p>
<h3>Are markets changing? (and must Trend Following change too?)</h3>
<p>The self-professed &#8220;Trend Following poster boy&#8221; (a.k.a. Michael Covel) authoratively declares that this is a <a href="http://www.michaelcovel.com/2009/10/13/the-ever-changing-markets-argument/" target="_blank" rel="nofollow">specious argument</a>.</p>
<blockquote><p>Occasionally, someone trying to promote something or start a debate will argue that trend following rules must always change due to changing market conditions. This is nonsense. It is a specious argument.</p></blockquote>
<p>This is at best ambiguous. Covel likes to cite Bill Dunn who:</p>
<blockquote><p>proffered that his basic system rules have not changed since 1974</p></blockquote>
<p>Now, that is seducing: it seems to sell you the idea that you can develop a system, implement it and trade it for life. However this is not strictly true. As mentioned in <a href="http://www.streetstories.com/dunn_art_futures.html" target="_blank" rel="nofollow">this interview</a>:</p>
<blockquote><p>Dunn annually adjusts the parameters of trading signals and each markets weighting. In February &#8211; just as the grains were about to take off &#8211; he dumped the entire grain sector. But Dunn has no regrets.</p></blockquote>
<p>Dunn is also known to have collaborated with Robert Pardo, a strong proponent of Walk-Forward testing (see below: a constant system adjustment).</p>
<p>To clarify: although Trend Following principles will never change, the rules/parameters of a Trend Following system might need to be adjusted to changing market conditions.</p>
<h3>How can a Trend Following strategy adapt to the ever-changing markets?</h3>
<p>In an <a href="http://www.activetradermag.com/index.php/c/Trading_Strategies/d/Tuning_up_the_turtle" target="_blank" rel="nofollow">Active Trader article</a>, Anthony Garner attempts to discuss:</p>
<blockquote><p>Do markets change? Is it necessary to undertake continued research and development and adapt a trend-following system to maintain its profitability over the years?</p></blockquote>
<p>The article is only available for the magazine subscribers, but the result of the equity curve can be found on the <a href="http://www.tradingblox.com/forum/viewtopic.php?t=7301" target="_blank" rel="nofollow">Trading Blox forum</a>. By &#8220;tuning up&#8221; the Turtle system, Garner manages to obtain interesting stats (MAR=2.26, CAGR=35.28%). The main change to the system is the use of a longer-term timeframe.</p>
<p><a href="http://www.tradingblox.com/forum/viewtopic.php?t=7301" target="_blank" rel="nofollow"><img src="http://www.automated-trading-system.com/wp-content/uploads/2010/03/tunedturtle_139.png" alt="tunedturtle_139" title="tunedturtle_139" width="166" height="125" class="alignnone size-full wp-image-1884" /></a></p>
<h3>Practically</h3>
<p>I know I would not be happy trading the original Turtle System in the last 20 years and get a 0% return. If you started trading this system &#8220;back then&#8221;, when and how would you think it is time to switch to a revised system?</p>
<p>Let&#8217;s look at options:</p>
<h4>1. Walk-Forward</h4>
<p><a href="http://www.automated-trading-system.com/walk-forward-testing/">Walk-Forward testing</a>&#8216;s principle is to keep running (in simulation) a &#8220;pool&#8221; of systems using different rules/parameters. At regular interval, you evaluate what systems are best (performance, robustness, etc.) and trade those until the next re-evaluation. The potential risk with this approach is that you might end up like a dog <em>chasing your tail</em>.</p>
<p>However, this approach would have you switched from the original Turtle system to the new one a while ago.</p>
<h4>2. Alternative Walk-Forward</h4>
<p>Markets exhibit some degree of inefficiency &#8211; and Trend Following is a strategy designed to profit from these inefficiencies. I am still refining my theoritical understanding and explanation of it, but I believe Trend Following&#8217;s performance is mostly the result of <a href="http://www.automated-trading-system.com/why-trend-following-works-look-at-the-distribution/">fat-tailed distributions</a> (distribution kurtosis) and possibly <a href="http://www.automated-trading-system.com/why-trend-following-works-autocorrelation/">autocorrelation</a>.</p>
<p>If one can associate the evolution of these characteristics to the performance of Trend Following systems it might be possible to adapt the system rules/parameters to the values and evolution of the price distribution characteristics. This is a topic I&#8217;d like to investigate further.</p>
<h4>3. Mixing Systems</h4>
<p>Finally, and this seems to be a strategy adopted by many professionals: mix different systems and different timeframes. Here the rationale is that we cannot predict what systems are going to under/over perform and mixing several ones together will smooth out the equity curve.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.automated-trading-system.com/intricacies-of-market-and-trend-following-changes/feed/</wfw:commentRss>
		<slash:comments>13</slash:comments>
		</item>
		<item>
		<title>Why Trend Following works: Autocorrelation?</title>
		<link>http://www.automated-trading-system.com/why-trend-following-works-autocorrelation/</link>
		<comments>http://www.automated-trading-system.com/why-trend-following-works-autocorrelation/#comments</comments>
		<pubDate>Wed, 24 Feb 2010 11:46:09 +0000</pubDate>
		<dc:creator>Jez Liberty</dc:creator>
				<category><![CDATA[Data]]></category>
		<category><![CDATA[Strategies]]></category>
		<category><![CDATA[Trend Following]]></category>
		<category><![CDATA[autocorrelation]]></category>
		<category><![CDATA[distribution]]></category>
		<category><![CDATA[kurtosis]]></category>
		<category><![CDATA[options]]></category>
		<category><![CDATA[Stats]]></category>

		<guid isPermaLink="false">http://www.automated-trading-system.com/?p=1783</guid>
		<description><![CDATA[Is it important to understand why Trend Following works (ie what are the sources of its profitability)? &#160; I believe yes. Because markets are non-stationary (changing all the time), their characteristics &#8211; including those at the root of Trend Following profits &#8211; are changing too. &#160; Understanding these market characteristics is a first step towards [...]]]></description>
			<content:encoded><![CDATA[<p><div id="attachment_1785" class="wp-caption alignleft" style="width: 260px"><img src="http://www.automated-trading-system.com/wp-content/uploads/2010/02/autocorrelation-kylemcdonald-300x300.jpg" alt="some Autocorrelation representation by kylemcdonald@flickr (CC)" title="autocorrelation-kylemcdonald" width="250" height="250" class="size-medium wp-image-1785" /><p class="wp-caption-text">some Autocorrelation representation by kylemcdonald@flickr (CC)</p></div>Is it important to understand <strong>why Trend Following works</strong> (ie what are the sources of its profitability)?<br />
&nbsp;<br />
I believe yes. Because markets are <strong>non-stationary</strong> (changing all the time), their characteristics &#8211; including those at the root of Trend Following profits &#8211; are changing too.<br />
&nbsp;<br />
Understanding these market characteristics is a first step towards being able to <strong>identify and measure them</strong>. This, in turn should be a step to linking Trend Following performance to the state of these market characteristics. Finally, this might be a step towards devising a way for a Trend Following strategy to <strong>adapt to these changing market characteristics</strong> (this last point makes a very big assumption: market characteristic changes can be predicted with some degree of accuracy).</p>
<h3>Kurtosis only?</h3>
<p>In an earlier post, I discussed how <a href="http://www.automated-trading-system.com/why-trend-following-works-look-at-the-distribution/">fat-tails are a reason for Trend Following success</a> (or in technical terms: the <strong>excess kurtosis</strong> of price distributions).</p>
<p>However, there is something unsatisfying in that explanation: if the kurtosis was the sole source of Trend Following success:<span id="more-1783"></span></p>
<ul>
<li>Random entries should work as well as any other entries</li>
<li>Strategies such as buying Out-of-The-Money (OTM) options (think Nassim Taleb for example) should exhibit similar performance to Trend Following (with the advantage of being a rather simpler strategy)</li>
</ul>
<h3>Something Extra?</h3>
<p>I recently came across <a href="http://www.automated-trading-system.com/wp-content/uploads/2010/02/AIMA.pdf" target="_blank" rel="nofollow">this paper (PDF)</a> explaining that Trend Following and OTM options buying are strategies exhibiting similar performance profiles. However, the conclusion of this paper was that <strong>Trend Following showed superior performance</strong>.</p>
<p>Additionally, there is definitely a measurable <strong>edge to Trend Following entries</strong> (such as this <a href="http://www.automated-trading-system.com/e-ratio-trading-edge/#e-ratio-filter-chart">Donchian breakout e-ratio calculation</a> shows). Random entries would not show such an edge.</p>
<p>So, there must be something extra to the kurtosis story explaining Trend Following success&#8230;</p>
<h3>Autocorrelation</h3>
<p>One hypothesis that I want to investigate further is <a href="http://en.wikipedia.org/wiki/Autocorrelation" target="_blank">autocorrelation</a> (also referred to serial correlation).</p>
<p>One of the main principles of Trend Following entries &#8211; in the face of conventional wisdom &#8211; is:</p>
<blockquote><p>Buy High and Sell Low</p></blockquote>
<p>Well, it should really say &#8220;Buy High, Sell Higher and Sell Short Low, Buy Back Lower&#8221;. The point is that <strong>Trend Following entries are made at extremes, in the direction of the extremes</strong>.</p>
<p>If market exhibit positive <strong>autocorrelation at extremes</strong>, it can be derived that following the direction of the extreme moves should provide an edge (positive expectancy). This would explain why Trend Following entries perform better than random entries and why Trend Following is a superior strategy to buying Out-of-The-Money options.</p>
<h3>Calculation Project</h3>
<p>Now, this sounds all well and fine <em>in theory</em> but does this stack up to verification?</p>
<p>To check this, I am planning to run some calculations on historical prices and see if markets exhibit such autocorrelation at extremes. Another aspect that will be interesting to look into is whether this autocorrelation evolves over time and whether these autocorrelation levels are autocorrelated themselves (ie is there some degree of predictability in the autocorrelation evolution).</p>
<p>Now, please note that I am stepping out of my comfort zone here: my &#8220;heavy maths&#8221; days are quite far behind me and I know that using statistics can be a minefield (because it is so easy to use it in an incorrect manner). For example, the &#8220;standard&#8221; correlation calculation (Pearson&#8217;s correlation coefficient) only determines linear dependence &#8211; although market data is non-linear. Might set myself up for some hardship but as we say in French: &#8220;Qui ne risque rien n&#8217;a rien&#8221; (no pain, no gain).</p>
<p>I am also thinking of getting <a href="http://www.amazon.com/exec/obidos/ASIN/0199280967/autotradblog-20" target="_blank" rel="nofollow">one</a> or <a href="http://www.amazon.com/exec/obidos/ASIN/0071276254/autotradblog-20" target="_blank" rel="nofollow">two</a> Econometrics books to give me a headstart on this. But if any of you clever readers have any suggestions or tips on any of the above, please let me know.</p>
<p>Please bear with me and stay tuned.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.automated-trading-system.com/why-trend-following-works-autocorrelation/feed/</wfw:commentRss>
		<slash:comments>12</slash:comments>
		</item>
	</channel>
</rss>

