You know the feeling, you work hard to research and establish a new idea or strategy. You put it to use and it works, so you raise your stakes and booooooooom, it instantly reverses and losses you a shed load of money. It can sometimes feel like the market has got it in for you or like somebody is watching you.
You don’t deploy a strategy to lose money
When you set out to deploy a strategy you don’t expect it to lose, so if you start doing something and it losses money you very often cut it loose. It doesn’t make money so why keep doing it? Typically the way market participants respond to a loss arcs back to an age when avoiding losses were much more important. What’s this glowing warm thing in front of me? What happens if I touch it? Ouch, that burns, I’m not going to touch it again.
If you start losing money, you tend to pull the plug pretty quickly and there ends your strategy, experiment, or idea.
A loss feels bigger than a winning start
So you deploy a strategy and it starts to produce good results so you increase stakes, then a little bad run, then a bigger one and suddenly you find yourself heading to breakeven. If fact because you increased stakes you evaporate your prior profit much faster than that it took to make it. But that’s OK as you expect things to swing about a bit. But then the breakeven becomes a loss and that gets bigger and you quit. You can’t believe you were up so much and ended up losing money.
The reality
The reality of the situation is that only over a very large sample set and with a consistent staking plan can you reliably get a decent picture of how a strategy will play out. Cut out too soon and you will never learn the true character of a strategy. But most pressure is brought to bear when you make a loss quickly or you lose a profit. It’s almost impossible at that point to keep going. All strategies have drawdowns however and you can’t really predict when they will occur, so to bail when one occurs means that you may cut a loss for sure, but you are also cutting out profitable strategies that have yet to mature as well.
The net effect is those good strategies get chucked out along with bad ones just because you started them at a moment when the strategy dipped. On the inverse side, you may get a lucky run with a poor strategy which then reverts to mean. So you successfully catch all the negatives and a few positives.
My approach
I don’t have any pre-defined sample size to follow for defining whether a strategy works or not. I know they exist but, as with all academic-led material, other metrics may distort the results.
For example, in racing, there are a number of metrics, distance, course, seasons, etc, any one of those could distort the true path of your returns. If you slap on an X size sample you can fall foul of those metrics. One may perform well just because it coincides with one of those metrics.
So I look at very long sample sizes, use a carefully defined staking plan and measure the variability of returns. At the start the variability will be high, you will swing positive or negative for a while, but before long that variation, usually return on total capital invested measured as a percentage, will revert and stabilise to a particular number. It’s that number that I am seeking, hopefully, a positive one!
Managing expectations
I currently have two new strategies that I am putting to use. I knew fairly quickly I was onto something when the variability settled positive, so at that point, I carefully looked at the reason for the positive variability. Both had positive and negative traits to start but I just kept on plugging away at small stakes until it stabilised. Even on small stakes, I’m happy to let something slip quite negative if the overall variability hasn’t settled. Once I’m satisfied that I can explain the reasons it’s positive, I put it to use. But if it never goes positive on a percentage return basis then I need to rethink.
One thing you also notice is that all sports and therefore strategies exhibit some seasonality. Therefore, unfortunately, it may take a full year before you fully understand properly how something works.
If you want a view on this topic, have a look at this post. This is at the higher end of variability so you usually won’t see something as extreme as this, but I was playing a certain game with this strategy. None the less you can see it’s profitable, but you could have easily fallen foul of the traits I have explained by not thoroughly testing it. It would have been another situation where a strategy ‘failed’ but in fact, you just never gave it enough time to fully mature. I’ve reproduced the graph for you.
