NexusFi: Find Your Edge


Home Menu

 





Backtesting experts, tick data vs market replay


Discussion in NinjaTrader

Updated
    1. trending_up 3,210 views
    2. thumb_up 0 thanks given
    3. group 1 followers
    1. forum 2 posts
    2. attach_file 0 attachments




 
Search this Thread

Backtesting experts, tick data vs market replay

  #1 (permalink)
 calhawk01 
baltimore marylnd
 
Experience: Beginner
Platform: ninja
Trading: es
Posts: 91 since May 2013
Thanks Given: 5
Thanks Received: 11

hi guys, i've created hundreds of strategies in the course of 4 years and i'm working on a strategy right now and the results are just puzzling me. I tend to not give any weight to backtesting results and look forward to testing the strategy live. but still i'm just curious what everyones inputs are.

the strategy is very simple and utilizes bid/ask and close data. i have tick data from cgq (both bid/ask & close). the results on tick data are good. The equity chart is a nice smooth rise over time, no huge blips anywhere. just steady upward trend. monte carlo also looks good. i've reviewed many trades vs the chart and they sound good.

what is puzzling to me is that the market replay results are completely different. the strategy essentially gets hammered. i was able to review some of the trades and noticed that since this particular strategy does not end the position EOD the trades were being executed based on the logic huge bid/ask spreads toward end of the day. i fixed that issue but the results are still just completely different that tick data.

now I am going to test this in the real world to see what happens. i'm just curious what peoples thoughts are. sorry i cannot share the logic behind the strategy.

why would tick data results be significantly different than market replay data?

Started this thread Reply With Quote

Can you help answer these questions
from other members on NexusFi?
Ninja Mobile Trader VPS (ninjamobiletrader.com)
Trading Reviews and Vendors
New Micros: Ultra 10-Year & Ultra T-Bond -- Live Now
Treasury Notes and Bonds
Deepmoney LLM
Elite Quantitative GenAI/LLM
Online prop firm The Funded Trader (TFT) going under?
Traders Hideout
The space time continuum and the dynamics of a financial …
Emini and Emicro Index
 
  #2 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,399 since Jun 2009
Thanks Given: 33,175
Thanks Received: 101,541


calhawk01 View Post
hi guys, i've created hundreds of strategies in the course of 4 years and i'm working on a strategy right now and the results are just puzzling me. I tend to not give any weight to backtesting results and look forward to testing the strategy live. but still i'm just curious what everyones inputs are.

the strategy is very simple and utilizes bid/ask and close data. i have tick data from cgq (both bid/ask & close). the results on tick data are good. The equity chart is a nice smooth rise over time, no huge blips anywhere. just steady upward trend. monte carlo also looks good. i've reviewed many trades vs the chart and they sound good.

what is puzzling to me is that the market replay results are completely different. the strategy essentially gets hammered. i was able to review some of the trades and noticed that since this particular strategy does not end the position EOD the trades were being executed based on the logic huge bid/ask spreads toward end of the day. i fixed that issue but the results are still just completely different that tick data.

now I am going to test this in the real world to see what happens. i'm just curious what peoples thoughts are. sorry i cannot share the logic behind the strategy.

why would tick data results be significantly different than market replay data?

Taking a guess, you are using exotic bar types like a renko based bar. Has been discussed a million times on futures.io (formerly BMT), all backtest results are false.

Mike

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
  #3 (permalink)
 calhawk01 
baltimore marylnd
 
Experience: Beginner
Platform: ninja
Trading: es
Posts: 91 since May 2013
Thanks Given: 5
Thanks Received: 11



Big Mike View Post
Taking a guess, you are using exotic bar types like a renko based bar. Has been discussed a million times on futures.io (formerly BMT), all backtest results are false.

Mike

Agree all backtest results are false. But they should give you some idea of how the system could perform.

I am not using Renko. Good old plain regular 1 Tick values. I've also used 1 minute values. Both on backtesting results are fine. But market replay is just all out of wack.

Just a minute ago i was observing all the orders that were being executed on market replay. I think i found the problem. Looks like even though price is trading at 80$ some how logic is able to buy it 1% less and sell it. This leads me to believe that the market replay bid/ask/last quotes have major noise in them. On the chart the 1% below price was never plotted. But the data must have. It happened so quickly for me to analyze it.

I'm going to try to add a spread value between close[0] and ask price to be less than 50 cents and hopefully that changes something

update---


adding the spread didn't change anything. looks like the last values are all corrupt. way to go NT market replay.

i guess at this point i'm just curious what everyone thinks of 1 tick values from cgq on NT backtest?

Started this thread Reply With Quote




Last Updated on October 18, 2014


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts