How to Manually Backtest a Trading ... - Forex School Online

Backtesting platforms?

Hello. I am just getting into forex and wondering if there are any platforms available for me to backtest potential trading strategies.
Looking for something that allows me to plonk in the criterias for a trade and allow it to run automatically, but manual ones are ok too if no such platforms exist
cheers thanks
submitted by Abies_Grouchy to Forex [link] [comments]

H1 Backtest of ParallaxFX's BBStoch system

Disclaimer: None of this is financial advice. I have no idea what I'm doing. Please do your own research or you will certainly lose money. I'm not a statistician, data scientist, well-seasoned trader, or anything else that would qualify me to make statements such as the below with any weight behind them. Take them for the incoherent ramblings that they are.
TL;DR at the bottom for those not interested in the details.
This is a bit of a novel, sorry about that. It was mostly for getting my own thoughts organized, but if even one person reads the whole thing I will feel incredibly accomplished.

Background

For those of you not familiar, please see the various threads on this trading system here. I can't take credit for this system, all glory goes to ParallaxFX!
I wanted to see how effective this system was at H1 for a couple of reasons: 1) My current broker is TD Ameritrade - their Forex minimum is a mini lot, and I don't feel comfortable enough yet with the risk to trade mini lots on the higher timeframes(i.e. wider pip swings) that ParallaxFX's system uses, so I wanted to see if I could scale it down. 2) I'm fairly impatient, so I don't like to wait days and days with my capital tied up just to see if a trade is going to win or lose.
This does mean it requires more active attention since you are checking for setups once an hour instead of once a day or every 4-6 hours, but the upside is that you trade more often this way so you end up winning or losing faster and moving onto the next trade. Spread does eat more of the trade this way, but I'll cover this in my data below - it ends up not being a problem.
I looked at data from 6/11 to 7/3 on all pairs with a reasonable spread(pairs listed at bottom above the TL;DR). So this represents about 3-4 weeks' worth of trading. I used mark(mid) price charts. Spreadsheet link is below for anyone that's interested.

System Details

I'm pretty much using ParallaxFX's system textbook, but since there are a few options in his writeups, I'll include all the discretionary points here:

And now for the fun. Results!

As you can see, a higher target ended up with higher profit despite a much lower winrate. This is partially just how things work out with profit targets in general, but there's an additional point to consider in our case: the spread. Since we are trading on a lower timeframe, there is less overall price movement and thus the spread takes up a much larger percentage of the trade than it would if you were trading H4, Daily or Weekly charts. You can see exactly how much it accounts for each trade in my spreadsheet if you're interested. TDA does not have the best spreads, so you could probably improve these results with another broker.
EDIT: I grabbed typical spreads from other brokers, and turns out while TDA is pretty competitive on majors, their minors/crosses are awful! IG beats them by 20-40% and Oanda beats them 30-60%! Using IG spreads for calculations increased profits considerably (another 5% on top) and Oanda spreads increased profits massively (another 15%!). Definitely going to be considering another broker than TDA for this strategy. Plus that'll allow me to trade micro-lots, so I can be more granular(and thus accurate) with my position sizing and compounding.

A Note on Spread

As you can see in the data, there were scenarios where the spread was 80% of the overall size of the trade(the size of the confirmation candle that you draw your fibonacci retracements over), which would obviously cut heavily into your profits.
Removing any trades where the spread is more than 50% of the trade width improved profits slightly without removing many trades, but this is almost certainly just coincidence on a small sample size. Going below 40% and even down to 30% starts to cut out a lot of trades for the less-common pairs, but doesn't actually change overall profits at all(~1% either way).
However, digging all the way down to 25% starts to really make some movement. Profit at the -161.8% TP level jumps up to 37.94% if you filter out anything with a spread that is more than 25% of the trade width! And this even keeps the sample size fairly large at 187 total trades.
You can get your profits all the way up to 48.43% at the -161.8% TP level if you filter all the way down to only trades where spread is less than 15% of the trade width, however your sample size gets much smaller at that point(108 trades) so I'm not sure I would trust that as being accurate in the long term.
Overall based on this data, I'm going to only take trades where the spread is less than 25% of the trade width. This may bias my trades more towards the majors, which would mean a lot more correlated trades as well(more on correlation below), but I think it is a reasonable precaution regardless.

Time of Day

Time of day had an interesting effect on trades. In a totally predictable fashion, a vast majority of setups occurred during the London and New York sessions: 5am-12pm Eastern. However, there was one outlier where there were many setups on the 11PM bar - and the winrate was about the same as the big hours in the London session. No idea why this hour in particular - anyone have any insight? That's smack in the middle of the Tokyo/Sydney overlap, not at the open or close of either.
On many of the hour slices I have a feeling I'm just dealing with small number statistics here since I didn't have a lot of data when breaking it down by individual hours. But here it is anyway - for all TP levels, these three things showed up(all in Eastern time):
I don't have any reason to think these timeframes would maintain this behavior over the long term. They're almost certainly meaningless. EDIT: When you de-dup highly correlated trades, the number of trades in these timeframes really drops, so from this data there is no reason to think these timeframes would be any different than any others in terms of winrate.
That being said, these time frames work out for me pretty well because I typically sleep 12am-7am Eastern time. So I automatically avoid the 5am-6am timeframe, and I'm awake for the majority of this system's setups.

Moving stops up to breakeven

This section goes against everything I know and have ever heard about trade management. Please someone find something wrong with my data. I'd love for someone to check my formulas, but I realize that's a pretty insane time commitment to ask of a bunch of strangers.
Anyways. What I found was that for these trades moving stops up...basically at all...actually reduced the overall profitability.
One of the data points I collected while charting was where the price retraced back to after hitting a certain milestone. i.e. once the price hit the -61.8% profit level, how far back did it retrace before hitting the -100% profit level(if at all)? And same goes for the -100% profit level - how far back did it retrace before hitting the -161.8% profit level(if at all)?
Well, some complex excel formulas later and here's what the results appear to be. Emphasis on appears because I honestly don't believe it. I must have done something wrong here, but I've gone over it a hundred times and I can't find anything out of place.
Now, you might think exactly what I did when looking at these numbers: oof, the spread killed us there right? Because even when you move your SL to 0%, you still end up paying the spread, so it's not truly "breakeven". And because we are trading on a lower timeframe, the spread can be pretty hefty right?
Well even when I manually modified the data so that the spread wasn't subtracted(i.e. "Breakeven" was truly +/- 0), things don't look a whole lot better, and still way worse than the passive trade management method of leaving your stops in place and letting it run. And that isn't even a realistic scenario because to adjust out the spread you'd have to move your stoploss inside the candle edge by at least the spread amount, meaning it would almost certainly be triggered more often than in the data I collected(which was purely based on the fib levels and mark price). Regardless, here are the numbers for that scenario:
From a literal standpoint, what I see behind this behavior is that 44 of the 69 breakeven trades(65%!) ended up being profitable to -100% after retracing deeply(but not to the original SL level), which greatly helped offset the purely losing trades better than the partial profit taken at -61.8%. And 36 went all the way back to -161.8% after a deep retracement without hitting the original SL. Anyone have any insight into this? Is this a problem with just not enough data? It seems like enough trades that a pattern should emerge, but again I'm no expert.
I also briefly looked at moving stops to other lower levels (78.6%, 61.8%, 50%, 38.2%, 23.6%), but that didn't improve things any. No hard data to share as I only took a quick look - and I still might have done something wrong overall.
The data is there to infer other strategies if anyone would like to dig in deep(more explanation on the spreadsheet below). I didn't do other combinations because the formulas got pretty complicated and I had already answered all the questions I was looking to answer.

2-Candle vs Confirmation Candle Stops

Another interesting point is that the original system has the SL level(for stop entries) just at the outer edge of the 2-candle pattern that makes up the system. Out of pure laziness, I set up my stops just based on the confirmation candle. And as it turns out, that is much a much better way to go about it.
Of the 60 purely losing trades, only 9 of them(15%) would go on to be winners with stops on the 2-candle formation. Certainly not enough to justify the extra loss and/or reduced profits you are exposing yourself to in every single other trade by setting a wider SL.
Oddly, in every single scenario where the wider stop did save the trade, it ended up going all the way to the -161.8% profit level. Still, not nearly worth it.

Correlated Trades

As I've said many times now, I'm really not qualified to be doing an analysis like this. This section in particular.
Looking at shared currency among the pairs traded, 74 of the trades are correlated. Quite a large group, but it makes sense considering the sort of moves we're looking for with this system.
This means you are opening yourself up to more risk if you were to trade on every signal since you are technically trading with the same underlying sentiment on each different pair. For example, GBP/USD and AUD/USD moving together almost certainly means it's due to USD moving both pairs, rather than GBP and AUD both moving the same size and direction coincidentally at the same time. So if you were to trade both signals, you would very likely win or lose both trades - meaning you are actually risking double what you'd normally risk(unless you halve both positions which can be a good option, and is discussed in ParallaxFX's posts and in various other places that go over pair correlation. I won't go into detail about those strategies here).
Interestingly though, 17 of those apparently correlated trades ended up with different wins/losses.
Also, looking only at trades that were correlated, winrate is 83%/70%/55% (for the three TP levels).
Does this give some indication that the same signal on multiple pairs means the signal is stronger? That there's some strong underlying sentiment driving it? Or is it just a matter of too small a sample size? The winrate isn't really much higher than the overall winrates, so that makes me doubt it is statistically significant.
One more funny tidbit: EUCAD netted the lowest overall winrate: 30% to even the -61.8% TP level on 10 trades. Seems like that is just a coincidence and not enough data, but dang that's a sucky losing streak.
EDIT: WOW I spent some time removing correlated trades manually and it changed the results quite a bit. Some thoughts on this below the results. These numbers also include the other "What I will trade" filters. I added a new worksheet to my data to show what I ended up picking.
To do this, I removed correlated trades - typically by choosing those whose spread had a lower % of the trade width since that's objective and something I can see ahead of time. Obviously I'd like to only keep the winning trades, but I won't know that during the trade. This did reduce the overall sample size down to a level that I wouldn't otherwise consider to be big enough, but since the results are generally consistent with the overall dataset, I'm not going to worry about it too much.
I may also use more discretionary methods(support/resistance, quality of indecision/confirmation candles, news/sentiment for the pairs involved, etc) to filter out correlated trades in the future. But as I've said before I'm going for a pretty mechanical system.
This brought the 3 TP levels and even the breakeven strategies much closer together in overall profit. It muted the profit from the high R:R strategies and boosted the profit from the low R:R strategies. This tells me pair correlation was skewing my data quite a bit, so I'm glad I dug in a little deeper. Fortunately my original conclusion to use the -161.8 TP level with static stops is still the winner by a good bit, so it doesn't end up changing my actions.
There were a few times where MANY (6-8) correlated pairs all came up at the same time, so it'd be a crapshoot to an extent. And the data showed this - often then won/lost together, but sometimes they did not. As an arbitrary rule, the more correlations, the more trades I did end up taking(and thus risking). For example if there were 3-5 correlations, I might take the 2 "best" trades given my criteria above. 5+ setups and I might take the best 3 trades, even if the pairs are somewhat correlated.
I have no true data to back this up, but to illustrate using one example: if AUD/JPY, AUD/USD, CAD/JPY, USD/CAD all set up at the same time (as they did, along with a few other pairs on 6/19/20 9:00 AM), can you really say that those are all the same underlying movement? There are correlations between the different correlations, and trying to filter for that seems rough. Although maybe this is a known thing, I'm still pretty green to Forex - someone please enlighten me if so! I might have to look into this more statistically, but it would be pretty complex to analyze quantitatively, so for now I'm going with my gut and just taking a few of the "best" trades out of the handful.
Overall, I'm really glad I went further on this. The boosting of the B/E strategies makes me trust my calculations on those more since they aren't so far from the passive management like they were with the raw data, and that really had me wondering what I did wrong.

What I will trade

Putting all this together, I am going to attempt to trade the following(demo for a bit to make sure I have the hang of it, then for keeps):
Looking at the data for these rules, test results are:
I'll be sure to let everyone know how it goes!

Other Technical Details

Raw Data

Here's the spreadsheet for anyone that'd like it. (EDIT: Updated some of the setups from the last few days that have fully played out now. I also noticed a few typos, but nothing major that would change the overall outcomes. Regardless, I am currently reviewing every trade to ensure they are accurate.UPDATE: Finally all done. Very few corrections, no change to results.)
I have some explanatory notes below to help everyone else understand the spiraled labyrinth of a mind that put the spreadsheet together.

Insanely detailed spreadsheet notes

For you real nerds out there. Here's an explanation of what each column means:

Pairs

  1. AUD/CAD
  2. AUD/CHF
  3. AUD/JPY
  4. AUD/NZD
  5. AUD/USD
  6. CAD/CHF
  7. CAD/JPY
  8. CHF/JPY
  9. EUAUD
  10. EUCAD
  11. EUCHF
  12. EUGBP
  13. EUJPY
  14. EUNZD
  15. EUUSD
  16. GBP/AUD
  17. GBP/CAD
  18. GBP/CHF
  19. GBP/JPY
  20. GBP/NZD
  21. GBP/USD
  22. NZD/CAD
  23. NZD/CHF
  24. NZD/JPY
  25. NZD/USD
  26. USD/CAD
  27. USD/CHF
  28. USD/JPY

TL;DR

Based on the reasonable rules I discovered in this backtest:

Demo Trading Results

Since this post, I started demo trading this system assuming a 5k capital base and risking ~1% per trade. I've added the details to my spreadsheet for anyone interested. The results are pretty similar to the backtest when you consider real-life conditions/timing are a bit different. I missed some trades due to life(work, out of the house, etc), so that brought my total # of trades and thus overall profit down, but the winrate is nearly identical. I also closed a few trades early due to various reasons(not liking the price action, seeing support/resistance emerge, etc).
A quick note is that TD's paper trade system fills at the mid price for both stop and limit orders, so I had to subtract the spread from the raw trade values to get the true profit/loss amount for each trade.
I'm heading out of town next week, then after that it'll be time to take this sucker live!

Live Trading Results

I started live-trading this system on 8/10, and almost immediately had a string of losses much longer than either my backtest or demo period. Murphy's law huh? Anyways, that has me spooked so I'm doing a longer backtest before I start risking more real money. It's going to take me a little while due to the volume of trades, but I'll likely make a new post once I feel comfortable with that and start live trading again.
submitted by ForexBorex to Forex [link] [comments]

Backtesting

Hi all,I recently read in the book,Naked Forex, that you shouldn't backtest your strategies automated and then use them for manual backtesting and you should rather backtest manually or with manual software eg.Forex Tester and backtest automated and use the strategy automated.What are your opinions and also what are some good preferably free manual backtesting software?
submitted by azmit to Forex [link] [comments]

How do you ACTUALLY back test?

Hi everyone,
I have been trading (Forex) for a while and fine-tuned my set of rules over time to be trading somewhat profitably. However, it is still quite manual and with that comes emotion. I use an Excel plugin (MexelTrader) that exports all live and historical data out of MT4 to excel and here I have been able to build my 'algorithm'. Although my excel is great and I have been able to automate large portions I have this feeling there must be alternatives that do more and are quickeeasier.
How do I actually backtest it, testing its performance over historical data and multiple currency pairs?
From what I have covered on Reddit and across the internet my options are either learn to code (Python it seems is best) or find someone who can code, to run a programme testing my parameters. Are these the only two options?
Any insight/assistance will be greatly received. I am looking to take my trading to the next step and see this as a vital step.
submitted by jordanpatrick to algotrading [link] [comments]

My First Year of Trading

So here it is, three more days and October begins, which marks one year of trading for me. I figured I would contribute to the forum and share some of my experience, a little about me, and what I've learned so far. Whoever wants to listen, that's great. This might get long so buckle up..
Three years ago, I was visiting Toronto. I don't get out much, but my roommate at the time travels there occasionally. He asked everyone at our place if we wanted to come along for a weekend. My roommate has an uncle that lives there and we didn't have to worry about a hotel because his uncle owns a small house that's unlived in which we could stay at. I was the only one to go with. Anyways, we walk around the city, seeing the sights and whatnot.
My friend says to me "where next?"
"I don't know, you're the tour guide"
"We can go check out Bay Street"
"what's 'Bay Street?'"
"It's like the Canadian Wall street! If you haven't seen it you gotta see it!"
Walking along Bay, I admire all the nice buildings and architecture, everything seems larger than life to me. I love things like that. The huge granite facades with intricate designs and towering pillars to make you think, How the fuck did they make that? My attention pivots to a man walking on the sidewalk opposite us. His gait stood out among everyone, he walked with such a purpose.. He laughed into the cell phone to his ear. In the elbow-shoving city environment, he moved with a stride that exuded a power which not only commanded respect, but assumed it. I bet HE can get a text back, hell he's probably got girls waiting on him. This dude was dressed to kill, a navy suit that you could just tell from across the street was way out of my budget, it was a nice fucking suit. I want that. His life, across the street, seemed a world a way from my own. I've worn a suit maybe twice in my life. For my first communion, it was too big for me, I was eleven or whatever so who gives a shit, right? I'm positive I looked ridiculous. The other time? I can't remember.
I want that. I want the suit. I want the wealth, the independence. I want the respect and power, and I don't give a shit what anyone thinks about it.
Cue self doubt.
Well, He's probably some rich banker's son. That's a world you're born into. I don't know shit about it. \sigh* keep walking..*

A year later, I'm visiting my parents at their house, they live an hour away from my place. My dad is back from Tennessee, his engineering job was laying people off and he got canned... Or he saw the end was near and just left... I don't know, hard to pay attention to the guy honestly because he kind of just drones on and on. ("Wait, so your mom lives in Michigan, but your dad moved to Tennessee... for a job?" Yea man, I don't fucking know, not going to touch on that one.) The whole project was a shit show that was doomed to never get done, the way he tells it. And he's obviously jaded from multiple similar experiences at other life-sucking engineer jobs. My mom is a retired nurse practitioner who no longer works because of her illness. I ask him what he's doing for work now and he tells me he trades stocks from home. I didn't even know you could do that. I didn't know "trading" was a thing. I thought you just invest and hope for the best.
"Oh that's cool, how much money do you need to do that?"
"Ehh, most say you need at least $25,000 as a minimum"
"Oh... guess I can't do that..."
Six months later, I get a call and it's my dad. We talk a little about whatever. Off topic, he starts asking if I'm happy doing what I'm doing (I was a painter, commercial and residential) I tell him yes but it's kind of a pain in the ass and I don't see it as a long term thing. Then he gets around to asking if I'd like to come work with him. He basically pitches it to me. I'm not one to be sold on something, I'm always skeptical. So I ask all the questions that any rational person would ask and he just swats them away with reassuring phrases. He was real confident about it. But basically he says for this to work, I have to quit my job and move back home so he can teach me how to trade and be by my side so I don't do anything stupid. "My Name , you can make so much money." I say that I can't raise the $25,000 because I'm not far above just living paycheck to paycheck. "I can help you out with that." Wow, okay, well... let me think about it.
My "maybe" very soon turned into a "definitely." So over the next six months, I continue to work my day job painting, and I try to save up what I could for the transition (it wasn't a whole lot, I sucked at saving. I was great at spending though!). My dad gives me a book on day trading (which I will mention later) and I teach myself what I can about the stock market using Investopedia. Also in the meantime, my dad sends me encouraging emails. He tells me to think of an annual income I would like to make as a trader, and used "more than $100,000 but less than a million" as a guideline. He tells me about stocks that he traded that day or just ones that moved and describes the basic price action and the prices to buy and sell at. Basically saying "if you bought X amount of shares here and sold it at X price here, you could make a quick 500 bucks!" I then use a trading sim to trade those symbols and try to emulate what he says. Piece of cake. ;)
Wow, that's way more than what I make in a day.
He tells me not to tell anyone about my trading because most people just think it's gambling. "Don't tell your Mom either." He says most people who try this fail because they don't know how to stop out and take a loss. He talks about how every day he was in a popular chatroom, some noob would say something like, "Hey guys, I bought at X price (high of day or thereabout), my account is down 80% .. uhh I'm waiting for it to come back to my entry price.. what do I do??"
Well shit, I'm not that fucking dumb. If that's all it takes to make it is to buy low, sell high, and always respect a stop then I'll be fantastic.
By the end of September, I was very determined. I had been looking forward everyday to quitting my painting job because while it used to be something I loved, it was just sucking the life out of me at this point. Especially working commercial, you just get worked like a dog. I wasn't living up to my potential with that job and I felt awful for it every minute of every day. I knew that I needed a job where I could use my brain instead of slaving my body to fulfill someone else's dream. "Someone's gotta put gas in the boss's boat" That's a line my buddy once said that he probably doesn't know sticks with me to this day.
It ain't me.
So now it was October 2018, and I'm back living with Mom n' Pops. I was so determined that on my last day of work I gave away all of my painting tools to my buddy like, "here, I don't need this shit." Moving out of my rental was easy because I don't own much, 'can't take it with ya.' Excited for the future I now spend my days bundled up in winter wear in the cold air of our hoarder-like basement with a space heater at my feet. My laptop connected to a TV monitor, I'm looking at stocks next to my dad and his screens in his cluttered corner. Our Trading Dungeon. I don't trade any money, (I wasn't aware of any real-time sim programs) I just watch and learn from my dad. Now you've got to keep in mind, and look at a chart of the S&P, this is right at the beginning of Oct '18, I came in right at the market top. Right at the start of the shit-show. For the next three or four weeks, I watch my dad pretty much scratch on every trade, taking small loss after small loss, and cursing under his breath at the screen.
Click.
"dammit."
Click.
"shit."
Click. Click.
"you fuck."
Click.
This gets really fucking annoying as time goes on, for weeks, and I get this attitude like ugh, just let me do it. I'll make us some fucking money. So I convince him to let me start trading live. I didn't know anything about brokers so I set up an account using his broker, which was Fidelity. It was a pain and I had to jump through a lot of hoops to be able to day trade with this broker. I actually had to make a joint account with my dad as I couldn't get approved for margin because my credit score is shit (never owned a credit card) and my net worth, not much. Anyways, they straight up discourage day trading and I get all kinds of warning messages with big red letters that made me shit myself like oooaaahhh what the fuck did I do now. Did I forget to close a position?? Did I fat finger an order? Am I now in debt for thousands of dollars to Fidelity?? They're going to come after me like they came after Madoff. Even after you are approved for PDT you still get these warning messages in your account. Some would say if I didn't comply with "whatever rule" they'd even suspend my account for 60 days. It was ridiculous, hard to describe because it doesn't make sense, and it took the support guy on the phone a good 20 minutes to explain it to me. Basically I got the answer "yea it's all good, you did nothing wrong. As long as you have the cash in your account to cover whatever the trade balance was" So I just kept getting these warnings that I had to ignore everyday. I hate Fidelity.
My fist day trading, I made a few so-so trades and then I got impatient. I saw YECO breaking out and I chased, soon realized I chased, so I got out. -$500. Shit, I have to make that back, I don't want my dad to see this. Got back in. Shit. -$400. So my first day trading, I lost $900. My dumbass was using market orders so that sure didn't help. I reeled the risk back and traded more proper position size for a while, but the commissions for a round trip are $10, so taking six trades per day, I'm losing $60 at a minimum on top of my losing trades. Quickly I realized I didn't know what the hell I was doing. What about my dad? Does HE know? One day, in the trading dungeon, I was frustrated with the experience I'd been having and just feeling lost overall. I asked him.
"So, are you consistently profitable?"
"mmm... I do alright."
"Yea but like, are you consistently profitable over time?"
.........................
"I do alright."
Silence.
"Do you know any consistently profitable traders?"
"Well the one who wrote that book I gave you, Tina Turner.. umm and there's Ross Cameron"
......................
"So you don't know any consistently profitable traders, personally.. People who are not trying to sell you something?"
"no."
...................
Holy fucking shit, what did this idiot get me into. He can't even say it to my face and admit it.
This entire life decision, quitting my job, leaving my rental, moving from my city to back home, giving shit away, it all relied on that. I was supposed to be an apprentice to a consistently profitable day trader who trades for a living. It was so assumed, that I never even thought to ask! Why would you tell your son to quit his job for something that you yourself cannot do? Is this all a scam? Did my dad get sold a DREAM? Did I buy into some kind of ponzi scheme? How many of those winning trades he showed me did he actually take? Are there ANY consistently profitable DAY TRADERS who TRADE FOR A LIVING? Why do 90% fail? Is it because the other 10% are scamming the rest in some way? Completely lost, I just had no clue what was what. If I was going to succeed at this, if it was even possible to succeed at this, it was entirely up to me. I had to figure it out. I still remember the feeling like an overwhelming, crushing weight on me as it all sunk in. This is going to be a big deal.. I'm not the type to give up though. In that moment, I said to myself,
I'm going to fucking win at this. I don't know if this is possible, but I'm going to find out. I cannot say with certainty that I will succeed, but no matter what, I will not give up. I'm going to give all of myself to this. I will find the truth.
It was a deep moment for me. I don't like getting on my soapbox, but when I said those things, I meant it. I really, really meant it. I still do, and I still will.
Now it might seem like I'm being hard on my dad. He has done a lot for me and I am very grateful for that. We're sarcastic as hell to each other, I love the bastard. Hell, I wouldn't have the opportunity to trade at all if not for him. But maybe you can also understand how overwhelmed I felt at that time. Not on purpose, of course he means well. But I am not a trusting person at all and I was willing to put trust into him after all the convincing and was very disappointed when I witnessed the reality of the situation. I would have structured this transition to trading differently, you don't just quit your job and start trading. Nobody was there to tell me that! I was told quite the opposite. I'm glad it happened anyway, so fuck it. I heard Kevin O'Leary once say,
"If I knew in the beginning how difficult starting a business was, I don't know that I ever would've started."
This applies very much to my experience.
So what did I do? Well like everyone I read and read and Googled and Youtube'd my ass off. I sure as hell didn't pay for a course because I didn't have the money and I'm like 99% sure I would be disappointed by whatever they were teaching as pretty much everything can be found online or in books for cheap or free. Also I discovered Thinkorswim and I used that to sim trade in real-time for three months. This is way the hell different than going on a sim at 5x speed and just clicking a few buy and sell buttons. Lol, useless. When you sim trade in real-time you're forced to have a routine, and you're forced to experience missing trades with no chance to rewind or skip the boring parts. That's a step up because you're "in it". I also traded real money too, made some, lost more than I made. went back to sim. Traded live again, made some but lost more, fell back to PDT. Dad fronted me more cash. This has happened a few times. He's dug me out of some holes because he believes in me. I'm fortunate.
Oh yeah, about that book my dad gave me. It's called A Beginner's Guide to Day Trading Online by Toni Turner. This book... is shit. This was supposed to be my framework for how to trade and I swear it's like literally nothing in this book fucking works lol. I could tell this pretty early on, intuitively, just by looking at charts. It's basically a buy-the-breakout type strategy, if you want to call it a strategy. No real methodology to anything just vague crap and showing you cherry-picked charts with entries that are way too late. With experience in the markets you will eventually come to find that MOST BREAKOUTS FAIL. It talks about support/resistance lines and describes them as, "picture throwing a ball down at the floor, it bounces up and then it bounces down off the ceiling, then back up." So many asinine assumptions. These ideas are a text book way of how to trade like dumb money. Don't get me wrong, these trades can work but you need to be able to identify the setups which are more probable and identify reasons not to take others. So I basically had to un-learn all that shit.
Present day, I have a routine in place. I'm out of the dungeon and trade by myself in my room. I trade with a discount broker that is catered to day traders and doesn't rape me on commissions. My mornings have a framework for analyzing the news and economic events of the particular day, I journal so that I can recognize what I'm doing right and where I need to improve. I record my screens for later review to improve my tape reading skills. I am actually tracking my trades now and doing backtesting in equities as well as forex. I'm not a fast reader but I do read a lot, as much as I can. So far I have read about 17-18 books on trading and psychology. I've definitely got a lot more skilled at trading.
As of yet I am not net profitable. Writing that sounds like selling myself short though, honestly. Because a lot of my trades are very good and are executed well. I have talent. However, lesser quality trades and trades which are inappropriately sized/ attempted too many times bring down that P/L. I'm not the type of trader to ignore a stop, I'm more the trader that just widdles their account down with small losses. I trade live because at this point, sim has lost its value, live trading is the ultimate teacher. So I do trade live but I just don't go big like I did before, I keep it small.
I could show you trades that I did great on and make people think I'm killing it but I really just don't need the validation. I don't care, I'm real about it. I just want to get better. I don't need people to think I'm a genius, I'm just trying to make some money.
Psychologically, to be honest with you, I currently feel beaten down and exhausted. I put a lot of energy into this, and sometimes I work myself physically sick, it's happened multiple times. About once a week, usually Saturday, I get a headache that lasts all day. My body's stress rebound mechanism you might call it. Getting over one of those sick periods now, which is why I barely even traded this week. I know I missed a lot of volatility this week and some A+ setups but I really just don't give a shit lol. I just currently don't have the mental capital, I think anyone who's been day trading every day for a year or more can understand what I mean by that. I'm still being productive though. Again, I'm not here to present an image of some badass trader, just keeping it real. To give something 100% day after day while receiving so much resistance, it takes a toll on you. So a break is necessary to avoid making bad trading decisions. That being said, I'm progressing more and more and eliminating those lesser quality trades and identifying my bad habits. I take steps to control those habits and strengthen my good habits such as having a solid routine, doing review and market research, taking profits at the right times, etc.
So maybe I can give some advice to some that are new to day trading, those who are feeling lost, or just in general thinking "...What the fuck..." I thought that every night for the first 6 months lol.
First of all, manage expectations. If you read my story of how I came to be a trader, you can see I had a false impression of trading in many aspects. Give yourself a realistic time horizon to how progress should be made. Do not set a monetary goal for yourself, or any time-based goal that is measured in your P/L. If you tell yourself, "I want to make X per day, X per week, or X per year" you're setting yourself up to feel like shit every single day when it's clear as the blue sky that you won't reach that goal anytime soon. As a matter of fact, it will appear you are moving further AWAY from that goal if you just focus on your P/L, which brings me to my next point.
You will lose money. In the beginning, most likely, you will lose money. I did it, you'll do it, the greatest Paul Tudor Jones did it. Trading is a skill that needs to be developed, and it is a process. Just look at it as paying your tuition to the market. Sim is fine but don't assume you have acquired this skill until you are adept at trading real money. So when you do make that leap, just trade small.
Just survive. Trade small. get the experience. Protect your capital. To reach break even on your bottom line is a huge accomplishment. In many ways, experience and screen time are the secret sauce.
Have a routine. This is very important. I actually will probably make a more in-depth post in the future about this if people want it. When I first started, I was overwhelmed with the feeling "What the fuck am I supposed to DO?" I felt lost. There's no boss to tell you how to be productive or how to find the right stocks, which is mostly a blessing, but a curse for new traders.
All that shit you see, don't believe all that bullshit. You know what I'm talking about. The bragposting, the clickbait Youtube videos, the ads preying on you. "I made X amount of money in a day and I'm fucking 19 lolz look at my Lamborghini" It's all a gimmick to sell you the dream. It's designed to poke right at your insecurities, that's marketing at it's finest. As for the bragposting on forums honestly, who cares. And I'm not pointing fingers on this forum, just any trading forum in general. They are never adding anything of value to the community in their posts. They never say this is how I did it. No, they just want you to think they're a genius. I can show you my $900 day trading the shit out of TSLA, but that doesn't tell the whole story. Gamblers never show you when they lose, you might never hear from those guys again because behind the scenes, they over-leveraged themselves and blew up. Some may actually be consistently profitable and the trades are 100% legit. That's fantastic. But again, I don't care, and you shouldn't either. You shouldn't compare yourself to others.
"Everyone's a genius in a bull market" Here's the thing.. Markets change. Edges disappear. Trading strategies were made by traders who traded during times when everything they did worked. Buy all the breakouts? Sure! It's the fucking tech bubble! Everything works! I'm sure all those typical setups used to work fantastically at some point in time. But the more people realize them, the less effective they are. SOMEONE has to be losing money on the opposite side of a winning trade, and who's willing to do that when the trade is so obvious? That being said, some things are obvious AND still work. Technical analysis works... sometimes. The caveat to that is, filters. You need to, in some way, filter out certain setups from others. For example, you could say, "I won't take a wedge pattern setup on an intraday chart unless it is in a higher time frame uptrend, without nearby resistance, and trading above average volume with news on that day."
Have a plan. If you can't describe your plan, you don't have one. Think in probabilities. You should think entirely in "if, then" scenarios. If X has happens, then Y will probably happen. "If BABA breaks this premarket support level on the open I will look for a pop up to short into."
Backtest. Most traders lose mainly because they think they have an edge but they don't. You read these books and all this stuff online telling you "this is a high probability setup" but do you know that for a fact? There's different ways to backtest, but I think the best way for a beginner is manual backtesting with a chart and an excel sheet. This builds up that screen time and pattern recognition faster. This video shows how to do that. Once I saw someone do it, it didn't seem so boring and awful as I thought it was.
Intelligence is not enough. You're smarter than most people, that's great, but that alone is not enough to make you money in trading necessarily. Brilliant people try and fail at this all the time, lawyers, doctors, surgeons, engineers.. Why do they fail if they're so smart? It's all a fucking scam. No, a number of reasons, but the biggest is discipline and emotional intelligence.
Journal every day. K no thanks, bro. That's fucking gay. That's how I felt when I heard this advice but really that is pride and laziness talking. This is the process you need to do to learn what works for you and what doesn't. Review the trades you took, what your plan was, what actually happened, how you executed. Identify what you did well and what you can work on. This is how you develop discipline and emotional intelligence, by monitoring yourself. How you feel physically and mentally, and how these states affect your decision-making.
Always be learning. Read as much as you can. Good quality books. Here's the best I've read so far;
Market Wizards -Jack Schwager
One Good Trade -Mike Bellafiore
The Daily Trading Coach -Bret Steenbarger
Psycho-cybernetics -Maxwell Maltz
Why You Win or Lose -Fred Kelly
The Art and Science of Technical Analysis -Adam Grimes
Dark Pools -Scott Patterson
Be nimble. Everyday I do my research on the symbols I'm trading and the fundamental news that's driving them. I might be trading a large cap that's gapping up with a beat on EPS and revenue and positive guidance. But if I see that stock pop up and fail miserably on the open amidst huge selling pressure, and I look and see the broader market tanking, guess what, I'm getting short, and that's just day trading. The movement of the market, on an intraday timeframe, doesn't have to make logical sense.
Adapt. In March I used to be able to buy a breakout on a symbol and swing it for the majority of the day. In the summer I was basically scalping on the open and being done for the day. Volatility changes, and so do my profit targets.
Be accountable. Be humble. Be honest. I take 100% responsibility for every dime I've lost or made in the market. It's not the market makers fault, it wasn't the HFTs, I pressed the button. I know my bad habits and I know my good habits.. my strengths/ my weaknesses.
Protect yourself from toxicity. Stay away from traders and people on forums who just have that negative mindset. That "can't be done" mentality. Day trading is a scam!! It can certainly be done. Prove it, you bastard. I'm posting to this particular forum because I don't see much of that here and apparently the mods to a good job of not tolerating it. As the mod wrote in the rules, they're most likely raging from a loss. Also, the Stocktwits mentality of "AAPL is going to TANK on the open! $180, here we come. $$$" , or the grandiose stories, "I just knew AMZN was going to go up on earnings. I could feel it. I went ALL IN. Options money, baby! ka-ching!$" Lol, that is so toxic to a new trader. Get away from that. How will you be able to remain nimble when this is your thought process?
Be good to yourself. Stop beating yourself up. You're an entrepreneur. You're boldly going where no man has gone before. You've got balls.
Acknowledge your mistakes, don't identify with them. You are not your mistakes and you are not your bad habits. These are only things that you do, and you can take action necessary to do them less.
It doesn't matter what people think. Maybe they think you're a fool, a gambler. You don't need their approval. You don't need to talk to your co-workers and friends about it to satisfy some subconscious plea for guidance; is this a good idea?
You don't need anyone's permission to become the person you want to be.
They don't believe in you? Fuck 'em. I believe in you.
submitted by indridcold91 to Daytrading [link] [comments]

I've reproduced 130+ research papers about "predicting the stock market", coded them from scratch and recorded the results. Here's what I've learnt.

ok, so firstly,
all of the papers I found through Google search and Google scholar. Google scholar doesn't actually have every research paper so you need to use both together to find them all. They were all found by using phrases like "predict stock market" or "predict forex" or "predict bitcoin" and terms related to those.

Next,
I only tested papers written in the past 8 years or so, I think anything older is just going to be heavily Alpha-mined so we can probably just ignore those ones altogether.

Then,
Anything where it's slightly ambiguous with methodology, I tried every possible permutation to try and capture what the authors may have meant. For example, one paper adds engineered features to the price then says "then we ran the data through our model" - it's not clear if it means the original data or the engineered data, so I tried both ways. This happens more than you'd think!

THEN,
Anything that didn't work, I tried my own ideas with the data they were using or substituted one of their models with others that I knew of.

Now before we go any further, I should caveat that I was a profitable trader at multiple Tier-1 US banks so I can say with confidence that I made a decent attempt of building whatever the author was trying to get at.

Oh, and one more thing. All of this work took about 7 months in total.

Right, let's jump in.

So with the papers, I found as many as I could, then I read through them and put them in categories and then tested each category at a time because a lot of papers were kinda saying the same things.
Here are the categories:
Results:
Literally every single paper was either p-hacked, overfit, or a subsample of favourable data was selected (I guess ultimately they're all the same thing but still) OR a few may have had a smidge of Alpha but as soon as you add transaction costs it all disappears.
Every author that's been publicly challenged about the results of their paper says it's stopped working due to "Alpha decay" because they made their methodology public. The easiest way to test whether it was truly Alpha decay or just overfitting by the authors is just to reproduce the paper then go further back in time instead of further forwards. For the papers that I could reproduce, all of them failed regardless of whether you go back or forwards. :)

Now, results from the two most popular categories were:

The most frustrating paper:
I have true hate for the authors of this paper: "A deep learning framework for financial time series using stacked autoencoders and long-short term memory". Probably the most complex AND vague in terms of methodology and after weeks trying to reproduce their results (and failing) I figured out that they were leaking future data into their training set (this also happens more than you'd think).

The two positive take-aways that I did find from all of this research are:
  1. Almost every instrument is mean-reverting on short timelines and trending on longer timelines. This has held true across most of the data that I tested. Putting this information into a strategy would be rather easy and straightforward (although you have no guarantee that it'll continue to work in future).
  2. When we were in the depths of the great recession, almost every signal was bearish (seeking alpha contributors, news, google trends). If this holds in the next recession, just using this data alone would give you a strategy that vastly outperforms the index across long time periods.
Hopefully if anyone is getting into this space this will save you an absolute tonne of time and effort.
So in conclusion, if you're building trading strategies. Simple is good :)

Also one other thing I'd like to add, even the Godfather of value investing, the late Benjamin Graham (Warren Buffet's mentor) used to test his strategies (even though he'd be trading manually) so literally every investor needs to backtest regardless of if you're day-trading or long-term investing or building trading algorithms.
submitted by chiefkul to StockMarket [link] [comments]

Trading the monthly chart

Forex newbie here. Started out, like many others I reckon, lurking in the lower shorter timeframes. Talking about the 1 Hour 4 hour and 15 minute charts.
I am now gravitating towards the higher time frames. In fact I am thinking of just looking at the weekly and monthly timeframes.
Are there any traders here who just trade off these charts? I e the weekly and monthly charts? Many thanks.
submitted by kazman to Forex [link] [comments]

So you wanna trade Forex? - tips and tricks inside

Let me just sum some stuff up for you newbies out there. Ive been trading for years, last couple of years more seriously and i turned my strategies into algorithms and i am currently up to 18 algorithms thats trading for me 24/7. Ive learned alot, listened to hundreds of podcasts and read tons of books + research papers and heres some tips and tricks for any newbie out there.

  1. Strategy - How to... When people say "you need a trading strategy!!" Its because trading is very hard and emotional. You need to stick to your rules at all times. Dont panic and move your stop loss or target unless your rules tell you to. Now how do you make these rules? Well this is the part that takes alot of time. If your rules are very simple (for example: "Buy if Last candles low was the lowest low of the past 10 candles." Lets make this a rule. You can backtest it manually by looking at a chart and going back in time and check every candle. or you can code it using super simple software like prorealtime, MT4 ++ Alot of software is basicly "click and drag" and press a button and it gives you backtest from 10-20-30 years ago in 5 seconds. This is the absolute easiest way to backtest rules and systems. If your trading "pure price action" with your drawn lines and shit, the only way to truly backtest that kind of trading is going in a random forex pair to a random point in time, could be 1 year ago, 1 month ago, 5 years ago.. and then you just trade! Move chart 1 candle at a time, draw your lines and do some "actual trading" and look at your results after moving forward in the chart. If you do not test your strategy your just going in blind, which could be disaster.. Maybe someone told u "this is the correct way to trade" or "this strategy is 90% sure to win every trade!!!" If you think you can do trading without a strategy, then your most likely going to look back at an empty account and wonder why you moved that stop loss or why you didnt take profit etc.. and then your gonna give up. People on youtube, forums, interwebz are not going to give you/sell you a working strategy thats gonna make you rich. If they had a working strategy, they would not give it away/sell it to you.
  2. Money management - How to.... Gonna keep this one short. Risk a small % of your capital on each trade. Dont risk 10%, dont risk 20%. You are going to see loosing trades, your probably gonna see 5-10 loss in a row!! If your trading a 1000$ account and your risking 100$ on each trade (10%) and you loose 5 in a row, your down -50% and probably you cant even trade cus of margin req. Game over.. Now how does one get super rich, super fast, from risking 1-3% of your account on each trade?? Well heres the shocking message: YOU CANT GET RICH FAST FROM TRADING UNLESS YOUR WILLING TO GO ALL IN! You can of course go all in on each trade and if you get em all right, you might get 1000%, then you go all in 1 more time and loose it all... The whole point of trading is NOT going bust. Not loosing everything, cus if you loose it all its game over and no more trading for you.
  3. Find your own trading style.... Everyone is different. You can have an average holding period of 1 month or you could be looking at a 1 min chart and average holding time = 10 minutes. For some, less volatility helps them sleep at night. For others, more volatility gives them a rush and some people crave this. There is no "correct" timeframes, or holding periods, or how much to profit or how much to loose. We are all individuals with different taste in risk. Some dont like risk, others wanna go all in to get rich over night. The smart approach is somewhere in the middle. If you dont risk anything, your not gonna get anything. If you risk everything, your most likely going to loose everything. When people are talking about trading style, this is kinda what that means.
  4. There are mainly 2 ways to trade: Divergence and Convergence. Or in other words: Mean reversion or trend following. Lets talk about them both: Trend following is trying to find a trend and stay with the trend until its over. Mean reversion is the belief that price is too far away from the average XX of price, and sooner or later, price will have to return to its average/mean (hence the name: MEAN reversion). Trend following systems usually see a lower winrate (30-40% winrate with no money management is not uncommon to see when backtesting trend following systems.. You can add good money management to get the winrate % higher. Why is the % winrate so low? Well a market, whatever that market is, tend to get real choppy and nasty right after a huge trend. So your gonna see alot of choppy fake signals that might kill 5-6 trades in a row, until the next huge trend starts which is going to cover all the losses from the small losses before the trend took off. Then you gotta hold that trade until trade is done. How do you define "when trend starts and stops"? Well thats back to point 1, find a strategy. Try defining rules for an entry and exit and see how it goes when you backtest it. For mean reversion the win % is usually high, like 70-90% winrate, but the average winning trade is alot smaller than the average loosing trade. this happens because you are basicly trying to catch a falling knife, or catch a booming rocket. Usually when trading mean reversion, waiting for price to actually reverse can very often leave you with being "too late", so you kinda have to find "the bottom" or "the top" before it actually has bottomed/ topped out and reversed. How can you do this you ask? Well your never going to hit every top or every bottom, but you can find ways to find "the bottom-ish" or "the top-ish", thens ell as soon as price reverts back to the mean. Sometimes your gonna wish you held on to the trade for longer, but again, back to point 1: Backtest your rules and figure that shit out.

Read these 4 points and try to follow them and you are at least 4 steps closer to being a profitable trader. Some might disagree with me on some points but i think for the majority, people are going to agree that these 4 points are pretty much universal. Most traders have done or are doing these things every day, in every trade.
Here is some GREAT material to read: Kevin Davey has won trading championship multiple times and he has written multiple great books, from beginner to advanced level. Recommend these books 100%, for example: Building winning algorithmic trading systems" will give you alot to work with when it comes to all 4 of the above points. Market wizards, Reminiscences of a stock operator are 2 books that are a great read but wont give you much "trading knowledge" that you can directly use for your trading. Books on "The turtles" are great reading. Then you have podcasts and youtube. I would stay away from youtube as much as possible when it comes to "Heres how to use the rsi!!!" or "this strategy will make you rich!!". Most youtube videoes are made by people who wanna sell you a course or a book. Most of this is just pure bullshit. Youtube can very harmfull and i would honestly advice about going there for "strategy adivce" and such. Podcasts tho are amazing, i highly recommend: Better systems trader, Chat with traders, Top traders unplugged, We study billionairs, to name a few :)
Also, on a less funny note.. Please realize that you are, and i am, real fucking stupid and lazy compared to the actual pro's out there. This is why you should not go "all in" on some blind stupid strategy youve heard about. This is why this is indeed VERY FUCKING HARD and most, if not everyone has busted an account or two before realizing just this. Your dumb.. your not going to be super rich within 1 year.. You can not start with 500$ account and make millions! (some might have been able to do this, but know that for every winner, theres 999 loosers behind him that failed... Might work fine first 5 trades, then 1 fuckup tho and ur gone..
And lastly: Try using a backtesting software. Its often FREE!!! (on a demo account) and often so simple a baby could use it. If your trading lines and such there exists web broweser "games" and softwares that lets you go "1 and 1 candle ahead" in random forex pairs and that lets you trade as if its "real" as it goes.
A big backtesting trap however is backtesting "losely" by just drawing lines and looking at chart going "oh i would have taken this trade FOR SURE!! I would have made so much money!!" however this is not actually backtesting, its cherry picking and its biased beyond the grave, and its going to hurt you. Try going 1 candle at a time doing "real and live" trades and see how it goes.

Bonus point!!
many people misunderstands what indicators like the RSI is telling you. Indeed something is "overbought" or "oversold" but only compared to the last average of xx amounts of bars/candles.
It doesn't tell you that RIGHT NOW is a great time to sell or buy. It only tells you that the math formula that is RSI, gives you a number between 1-100, and when its above 70 its telling you that momentum is up compared to the last average 14 candles. This is not a complete buy/sell signal. Its more like a filter if anything. This is true for MOST indicators. They INDICATE stuff. Dont use them as pure buy/sell signals.. At least backtest that shit first! Your probably gonna be shocked at the shitty results if you "buy wehn rsi is undeer 30 and sell when RSI is above 70".

Editedit: Huge post already, why not copy paste my comment with an example showing the difference in trend following vs mean reversion:
The thing about trend following is that we never know when a trade starts and when it ends. So what often happens is that you have to buy every breakout going up, but not every breakout is a new trend. Lets do an example. Check out the photo i included here: https://imageshost.eu/image/image.RcC

THE PHOTO IS JUST AN EXAMPLE THAT SHOWS WHY A TYPICAL TREND FOLLOWING STRATEGY HAVE A "LOW" WINRATE.
THE PHOTO IS NOT SHOWING AN EXAMPLE OF MY STRATEGIES OR TRADING.

  1. We identify the big orange trend up.
  2. We see the big break down (marked with the vertical red line) this is telling us we are not going higher just yet. Our upwards trend is broken. However we might continue going up in a new trend, but when will that trend come?
  3. We can draw the blue trend very earyly using highs and lows, lines up and down. Then we begin to look for breakouts of the upper blue line. So every time price breaks upper blue line we have to buy (cus how else are we going to "catch the next trend going up?)
As you can see we get 5 false breakouts before the real breakout happens!
Now if you could tell fake breakouts from real breakouts, your gonna be rich hehe. For everyone else: Take every signal you can get, put a "tight" stop loss so in case its a fake signal you only loose a little bit. Then when breakout happens as you can clearly see in chart, your going to make back all the small losses.
So in this example we fail 5 times, but get 1 HUGE new trend going further up. This 1 huge trade, unless we fuck it up and take profits too early or shit like that, is going to win back all those small losses + more.
This is why trend following has a low winrate. You get 5 small loss and 1 big win.

Now lets flip this! Imagine if your trading Mean reversion on all the same red arrows! So every time price hits the blue line, we go short back to the bottom (or middle) again! You would have won 5 trades with small profits, but on that last one you would get stopped out so hard. Meaning 5 small wins, 1 big loss (as some have pointed out in comments, if you where trading mean reverting you would wanna buy the lows as well as short the tops - photo was suppose to show why trend following strategies have a lower % winrate.)

Final edit: sorry this looks like a wall of text on ur phones.
submitted by RipRepRop to Forex [link] [comments]

I've reproduced 130+ research papers about "predicting bitcoin", coded them from scratch and recorded the results. Here's what I've learnt.

ok, so firstly,
all of the papers I found through Google search and Google scholar. Google scholar doesn't actually have every research paper so you need to use both together to find them all. They were all found by using phrases like "predict bitcoin" or "predict stock market" or "predict forex" and terms related to those.

Next,
I only tested papers written in the past 8 years or so, I think anything older is just going to be heavily Alpha-mined so we can probably just ignore those ones altogether.

Then,
Anything where it's slightly ambiguous with methodology, I tried every possible permutation to try and capture what the authors may have meant. For example, one paper adds engineered features to the price then says "then we ran the data through our model" - it's not clear if it means the original data or the engineered data, so I tried both ways. This happens more than you'd think!

THEN,
Anything that didn't work, I tried my own ideas with the data they were using or substituted one of their models with others that I knew of.

Now before we go any further, I should caveat that I was a profitable trader at multiple Tier-1 US banks so I can say with confidence that I made a decent attempt of building whatever the author was trying to get at.

Oh, and one more thing. All of this work took about 7 months in total.

Right, let's jump in.

So with the papers, I found as many as I could, then I read through them and put them in categories and then tested each category at a time because a lot of papers were kinda saying the same things.

Here are the categories:

Results:
Literally every single paper was either p-hacked, overfit, or a subsample of favourable data was selected (I guess ultimately they're all the same thing but still) OR a few may have had a smidge of Alpha but as soon as you add transaction costs it all disappears.

Every author that's been publicly challenged about the results of their paper says it's stopped working due to "Alpha decay" because they made their methodology public. The easiest way to test whether it was truly Alpha decay or just overfitting by the authors is just to reproduce the paper then go further back in time instead of further forwards. For the papers that I could reproduce, all of them failed regardless of whether you go back or forwards. :)

Now, results from the two most popular categories were:

The most frustrating paper:
I have true hate for the authors of this paper: "A deep learning framework for financial time series using stacked autoencoders and long-short term memory". Probably the most complex AND vague in terms of methodology and after weeks trying to reproduce their results (and failing) I figured out that they were leaking future data into their training set (this also happens more than you'd think).

The two positive take-aways that I did find from all of this research are:
  1. Almost every instrument is mean-reverting on short timelines and trending on longer timelines. This has held true across most of the data that I tested. Putting this information into a strategy would be rather easy and straightforward (although you have no guarantee that it'll continue to work in future).
  2. When we were in the depths of the great recession, almost every signal was bearish (seeking alpha contributors, news, google trends). If this holds in the next recession, just using this data alone would give you a strategy that vastly outperforms the index across long time periods.

Hopefully if anyone is getting into this space this will save you an absolute tonne of time and effort.

So in conclusion, if you're building trading strategies, simple is good :)

Also one other thing I'd like to add, even the Godfather of value investing, the late Benjamin Graham (Warren Buffet's mentor) used to test his strategies (even though he'd be trading manually) so literally every investor needs to backtest regardless of if you're day-trading or long-term investing or building trading algorithms.


EDIT: in case anyone wants to read more from me I occasionally write on medium (even though I'm not a good writer)
submitted by chiefkul to CryptoCurrency [link] [comments]

Overwhelmed with probablilities

So I've been trading forex for roughly a year and a half now and have had a varing degrees of succsess. Over this time, one thing that became increasingly apparent was that I had no conclusive evidence I actually had an edge -- sure, support / resitence *seemed* to work and gave periods of success but these were often followed by equally large periods of failure leading me to loose confidence in various approaches and strategies.
So at this point the logical thing to do was to take a step back and backtest. Sure, this would probably have been better to do before any trading what so ever but sometimes you need to fail first to see why you need to do something. Anyway, queue some limitied manual backtesting...
Doing this I realised several things:
  1. there are so many variables. Entries, exits, pyramiding, stop placement, profit targets and changing any one of these can have huge effects on your results, let alone all the various combinations of these factors.
  2. A sample set of 50 - 100 trades on one pair is nothing. I quickly realised that a strategy that works for EUUSD over the last year, doesn't necessarily mean that it would have worked the previous year... or next year... or on another pair... or 20 pairs.
Next, queue some automated backtesting...
So after realising the butterfly effect of changing you entry strategy or approach to take profits I decided to automate the process to speed things up and open up the possibility of trying more variable combinations. This is kind of where I'm at now - I'm using pinescript to test strategies (I get that this isn't exactly the gold standard for backtesting but it seems like a reasonable way to get started) - and am having generally mixed to poor results. The general issue being consistency, what works on one pair doesn't work on another, large periods of drawdown etc. Coupled with this is just the overwhelming sense that most strategies are just temporary runs of consistency in an otherwise chaotic system. The same as getting 5 heads in a row in a series of coin flips.

So I guess my question(s) is this:
Has anyone else been through this process of discovery and come out the other end -- and to those who are professional traders ( or at least have numerous years of consistent profitablitly ) how did you come to trust your system and know for sure that (for argument sake) closing a whole trade at 3R works better statistically than scaling out or using an exit indicator?
Additionally, my most consistent results seem to come when aiming for a a low r:r, even as low as 1:1 -- does any body trade a system that focusses on small consistent profits over the 'homerun' type approaches?

*Edit* Maybe a slightly more succinct summary of my point / question would be:
Having seen how the smallest variable can wildly change the results of an automated backtest over a data set of numerous years, coupled with the fact that strategies can fluctuate between profitable and unprofitable, in essense, at random: Is forex, esspecially if trading based on intuition or a system that you change based on your 'gut', no better than betting on roulette unless routed in hard, extensive statistical evidence?
submitted by wizzzzzyyyyy to Forex [link] [comments]

How do you backtest?

Let's say you have a technical analysis strategy that sorta kinda seems like it might work at first glance. How do you accurately test it in a way that you can identify not only whether it works or not, but why it does or doesn't? Is there a program that does this?
submitted by WillTrade4Food to Forex [link] [comments]

For those of you interested in the algo trading bot I posted a couple weeks ago, I will be releasing a market watcher only version of it (beta) for free

Hi guys, I know a lot of people expressed interest in the algo trading bot I posted about a few weeks ago: https://www.reddit.com/passive_income/comments/c8ocr5/after_months_of_tweaking_ive_finally_got_my_algo/

I thought about it, and I finally figured out how to release it publicly without it impacting my trading.
For the public version, I'm going to strip out the live trading functionality, and have it be a market-watcher only system. Essentially, you'll be able to configure specific strategies, and have it notify you when that strategy has a buy/sell signal emerge (so you'd have to do the trade manually)

You'll be able to run a backtest on any particular planned trading pair (eg USD-TSLA, BTC-ZEC, CAD-GBP), which will output a CSV sheet with backtested data against every possible strategy ordered by profitability.

You'll then be able to create market watchers (what I dub 'Tipsters', essentially live paper-traders) with the following settings:

These tipsters will then watch the market live, and simulate trading/keep track of simulated profitability.
App will have the following features:

There's a couple other 'surprises' I plan on having in the app too, but I'll keep those a secret for now (mostly hilarious stuff, but may wind up being useful).


So the question is, would you make use of something like this? Would you find it useful?
submitted by MrGruntsworthy to passive_income [link] [comments]

Help with manual backtesting

Hello everyone, I'm kinda new to trading and I want to start doing backtesting but without spending money on Forex tester for now. Any good options for manual testing? I was thinking mt4 candle by candle and input values into a excel sheet, the problem here is how to build that excel sheet, what values to put it, and what calculations do I need to set everything up nicely and good. Is there any tester for mt4 free or something like that? Any help would be good.
THANKS 😀
submitted by darksidersfk to Forex [link] [comments]

Demystify backtesting for me

Im looking for those traders that do it manually and use price action strategies, no indicators. Does it work on PA...?
Do you account for multi frame analysis or you only backtest on one timeframe?
What about news, how do you account for fundamental effects on price or you dont?
Thanks
submitted by fxcode to Forex [link] [comments]

Strategy - Why you should backtest your systems

Hello world. Long time lurker here. Wanna give a huge tip to all newbies out there thats thinking about strategies. (like "Buy when price crosses above moving average 10" or whatever)

If you think you have a strategy (a set of rules) then theres no excuse not to backtest the rules!
Lets say you wanna "Buy when moving average[10] crosses over moving average[20]" or whatever numbers or indicators or rules youre thinking about.
All you gotta do is sign up with a broker (demo account!! free) that provides you with a software that allows you to backtest! The coding is 9/10 times super duper easy to learn and use. Just google for it and you should find multiple brokers that can provide different types of software to run backtests.

"Cant you just backtest manually looking at chart?" - Well, you can! But this takes a long long time and you will not see exact results. Using a software you can test your strategy on all the different timeframes, multiple years back in time, on all the currency pairs you want to test it on.
Heres an example, its my own algorithm (algorithm just means "set of rules") that i have created for USD/JPY, backtested from 2004 -> 2019 thats 15 years of backtesting! My system seemed profitable and robust so i decided to run this system live and its actually in a trade right now. So far its been profitable and good to me.

For all you traders that do not rely on fixed systems/set of rules: Backtesting is very hard because if you rely on your own drawings and support/resistance lines, then backtesting is biased before you even begin.. unless your testing in "real time" which of course is much more valid. Non the less you should just scroll "back in time" on chart and start "trading" with "paper money" and just move 1 and 1 candle forward until you either see that your system is working or not.

https://imgur.com/a/p8aVdIT

Edit: Guess i never answered "Why" you should backtest. I started out trading stocks, then i realized "patterns" was a thing in every chart on all timeframes and i started to look at forex cus markets are plentiful and open 24/5. After a few hit and missed and busted tiny accounts i realized i needed to test my theories and strategies. Thats when i discovered that coming up with a strategy that actually works, year after year on multiple pairs, is not only hard, its realy fucking hard! And thats also when i realized how flawed my "plans to get rich in trading" really was.. When your just charting and drawing lines and trading on them, you dont really have a plan, and without a firm strict plan (at least for me) the pitfalls are many, and devastating. So i started looking at how to actually make profitable strategies, reading books and listening to podcasts, and today im running multiple strategies in multiple markets on multiple timeframes. So far ive been profitable. definitly not gonna quit my dayjob tomorrow, just so thats clear.. trading is risky and having a dayjob and monthly income is definitly something im gonna continue with lol.
submitted by RipRepRop to Forex [link] [comments]

A few questions

Hey, used to trade a little bit a few years ago, and now I am coming back to trading. I’m looking to start algo trading because I have been doing a lot of dev work these past few years.
I’m looking to make my program with the Julia programming language.
  1. What brokerage do you guys use? I am interested in no-fee brokerages. I have my eyes set on TradeZero.
  2. What do you guys use for backtesting? I’ve read about Quantopia but I’d like something more local/private
  3. Who’s market data do you use?
  4. Has algo trading resulted in better results than manually trading with the assistance of tools such as screeners?
  5. Would algo trading be better for forex than securities markets since it is largely based on trends?
submitted by AlphonseWestwood to algotrading [link] [comments]

Backtesting with Forex Tester software

Hey guys, I'm fairly new to forex and was looking into purchasing the Forex Tester software for backtesting and was wondering if anyone here would recommend it. Or for that matter, if anyone would recommend backtesting software period as opposed to just doing it manually.
submitted by Korok123 to Forex [link] [comments]

Indicators

does anyone here trade souly indicators and are profitable? or has anyone ever herd of anyone?
submitted by whist12341234 to Forex [link] [comments]

My experiences of implementing an automated trading bot from scratch

A few weeks ago a friend of mine introduced me to Forex and I immediately wanted to implement a bot for it.
I started to write a backtest + real time trading bot in Rust from scratch.
I went with Oanda because it supports intra day forex data for the last 18 years (Although it is pretty slow). Ducascopy also offers intra day data which I use to initialize my database and Oanda only keeps it up to date. Also Oanda limits history to 5k data points per request.
We currently concentrate on trading strategies for M30 only. We already have a few winning strategies, but the return is very very small. Manual trading at the moment is much more profitable.
Running a strategy with a few indicators is relatively fast. M30 for the last 16 years usually only takes a few ms (single threaded).
The API currently looks like this:
fn run(&self, order: &mut impl Order) { crosses(&self.fast_ema, &self.slow_ema).map(|cross| match cross { Cross::Up => { order.exit_all(Direction::Short); order.enter( Direction::Long, Profit::Stop(self.take_profit), Loss::Stop(self.stop_loss), ); } Cross::Down => { order.exit_all(Direction::Long); order.enter( Direction::Short, Profit::Stop(self.take_profit), Loss::Stop(self.stop_loss), ); } }); } 
The TP and SL only use the close data for the M30 candle. I am still thinking about a good way to get 'real time' data into back testing. I don't think it will impact the performance at all because I only do a few thousand trades in the 16 years, which is nothing.
I have looked into a few databases but I just sort of rolled my own for now. Because I currently focus on M30, I just serialize everything into a single binary file. This will get a bit trickier once I start to work with S1. Either I store the data in chunks, or I'll switch to a real database. I still need to do a few benchmarks to see how much performance I will lose (if any). Iteration speed is the only stat I care about. Also fast indexing for dates would be useful. Which database do you use?
Almost everything is currently single threaded, besides a few threads that collect real time data. I don't think inner parallelism for strategies will be a net benefit and I will only run strategies in parallel in the future.
Indicators with history all use a ring buffer under the hood, which is important if I want to run multiple strategies at the same time, otherwise I would run out of memory very quickly.
I am absolutely not happy with my current plotting implementation. I am just using highstock(a javascript library) but it is not very performant. It works okay for <1KK datapoints. I think in the future I need to split the data into several chunks, and render them separately. I probably will use Qt with its plotting APIs.
Looking back, I really should have done more research, I just found out about algotrading today and I discovered a few good looking libraries like backtrader.
Any feedback is appreciated
submitted by MaikKlein to algotrading [link] [comments]

Looking for a good starting point - does MultiCharts fit the bill?

I'm fairly new to trading, coding, and finance, but I've begun developing a strategy that I'd like to flesh out. I've done some manual backtests and they seem promising, but I don't have a big enough sample size to really feel confident about it yet. I figured that the best thing to do is to develop an algorithm that I can backtest with a lot of data, but I'm feeling a bit unsure where to start presented with all these different options combined with my inexperience.
I've been using QuantConnect a bit, but I'm not thrilled with the fact that certain staff members can view my code, so I want to switch to something that won't have that issue. I was originally looking at Python platforms, but I've heard that it executes too slowly and I should be looking at building my algorithm in C# or C++. I'm not looking to execute on tick data as of now, and the lowest time frame I can anticipate going is 1 minute, although more likely it's 5 minutes. Will the speed issue come into play on those time frames? I'd also like to get into machine learning eventually and as far as I know Python is better for that so seems like there may be a bit of a trade off...that said, I'd imagine there's a way to integrate Python machine learning with C# or C++, but perhaps that's my ignorance speaking.
Someone on here recommended using MultiCharts - does this seem like a good starting point? I'm worried about getting too deep into developing my own platform and MultiCharts seems fairly user friendly as far as having a GUI and robust platform. I'd really like to just get straight into developing and testing my strategy, as that's what got me interested in algotrading to begin with.
Oh, the strategy is based on forex, if that's helpful. Thanks in advance for any input!
submitted by prokcomp to algotrading [link] [comments]

Simple strategy is most successful, where to go from here?

Hello,

I've been dabbling in stocks, I have some experience in Forex. For the past few months I have been refining, backtesting and considering different strategies. I have been papertrading the ones that showed most potential. This simple reversal strategy https://imgur.com/9mHcply on tech giants AAPL, MSFT, CSCO has shown the greatest promise although it is painfully simple. I wont have a ton of time to research in the upcoming months so I wanted to check a few of things to not pointlessly disperse my efforts.
How to approach strategy/risk management improvement? Is there any software that might be helpful or tweaking manually based on performance is the only sound way?
The strategy is backtested in the market as we know it in the past years. How to be perceptive of changing market conditions? For now I am tracking performance month over month.
How do you guys approach crash protection?
I've traded simple strategies with descent success before, but as I am lacking experience in stocks and am afraid of going in with something "too simple to work."
Thank you!
submitted by Ambitious__Inflation to StockMarket [link] [comments]

Free Forextory Trading Tool - Best Forex Trading Simulator 2019

If you wanna backtest your system or practice trading strategies manually with the tick data 99% (exact to milliseconds), feel free to use this tool👇
Free Forextory Trading Tool - Best Forex Trading Simulator 2019

forex #forextradingtool #tradingsimulator

submitted by divergentami to FOREXTORY [link] [comments]

How To Back Manually and Back Testing With MT4 Tutorial [Forex Trading] How to backtest a trading ... How to BACKTEST a Forex Trading Strategy - YouTube How to backtest your trading strategy even if you don't ... How to Get Started with Free Forex Backtesting Software ...

Backtesting a trading strategy in Forex or any other type of market is vital if you want to have a profitable strategy or if you want to optimize your strategy to gain better results. Sometimes your strategy is performed without any EAs or trading robots so you need to take a manual approach, however, doing all the backtesting completely manually is very hard so we can do that with the help of ... Manual back-testing simulates the live environment using past data and performance, this can enhance your trading and increase your probability for success. Forex Tester 4 is still the best Forex backtesting software for manual testing. I can't say that I'm surprised. However, I'm extremely surprised (in a good way) with Soft4X. It has matured into a very viable backtesting option. If you're strapped for cash, or if you aren't sure if Forex trading is for you or not, then it's totally worth checking out Soft4X. The only caveat to that statement is ... In this article, we are going to see what information we need to collect for a manual backtest, particularly in forex; how to gather them, what can be found in a backtesting report and what do they tell us and how we can calculate the information we’ve gathered using Excel. If you are new to backtesting and you want to know what the backtesting is or how we can backtest automatically and ... Whilst setting manual profit targets with a set and forget strategy is popular, you may choose to use this style of backtesting to work on many other strategies such as using breakeven, trailing your stop loss for more profits, using multiple profit target points, or even manually managing your trade as price moves.. Using Other Tools to Backtest. The method I have just outlined to backtest is ... / Forex Backtesting / How to Do MetaTrader 5 Manual Backtesting. By: Hugh Kimura Last Updated: May 20, 2020. MetaTrader 5 is a solid automated backtesting platform. But did you know that it's also a pretty good manual backtesting platform? In this post, I'll show you how to use this free software to manually backtest your strategies. This is a great option if you don't want to purchase ... Meta Trader 4 is no doubt the most popular trading platform which is supported by more than 90% of the forex brokers. But MT4 too has its drawbacks. Lack of features for manual backtesting is one of them. Since back testing of strategies is as important as forward testing, we traders have two options. Make do with what we have on MT4 and look for a 3rd party software for testing purposes or ...

[index] [10525] [6920] [28396] [16411] [19928] [11570] [27281] [21156] [26489] [17249]

How To Back Manually and Back Testing With MT4

In this training video, you’ll learn: 1. How to backtest your trading strategy without coding (for free) 2. The ONE thing you must have before you start back... Back Testing is one of the most important things a Forex Trader should do before attempting to trade the markets. Manually back testing can be very boring but is necessary for your own piece of ... Learn how to get free Forex backtesting software. ★ SUBSCRIBE: http://tradr.cc/mu8d Some traders don't get started with backtesting because they don't want t... This video will show you How to Backtest a Forex Trading Strategy, as well as 3 TIPS on BACKTESTING... Trading Platform I Use: https://www.tradingview.com/... FREE: Advanced Pattern Tutorial - https://www.thetradingchannel.net/optinpage CHECK OUT: EAP Training Program - https://goo.gl/7RrMM5 JOIN: "Advanced Pattern...

http://binaryoptiontrade.felreri.tk