NexusFi: Find Your Edge


Home Menu

 





Speeding up NinjaTrader with a RAM drive (ramdisk)


Discussion in NinjaTrader

Updated
      Top Posters
    1. looks_one Big Mike with 20 posts (13 thanks)
    2. looks_two Zondor with 18 posts (24 thanks)
    3. looks_3 kronie with 14 posts (2 thanks)
    4. looks_4 bob7123 with 12 posts (15 thanks)
      Best Posters
    1. looks_one pawnbroker with 3.4 thanks per post
    2. looks_two Zondor with 1.3 thanks per post
    3. looks_3 bob7123 with 1.3 thanks per post
    4. looks_4 Big Mike with 0.7 thanks per post
    1. trending_up 60,629 views
    2. thumb_up 94 thanks given
    3. group 41 followers
    1. forum 111 posts
    2. attach_file 6 attachments




 
Search this Thread

Speeding up NinjaTrader with a RAM drive (ramdisk)

  #101 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,440 since Jun 2009
Thanks Given: 33,215
Thanks Received: 101,599

I ran into stability problems with NinjaTrader on a ramdisk, and definitely would not recommend.

I would try and solve the PrimoCache problem instead. Has been fine for me so far.

Sent from my LG Optimus G Pro

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote

Can you help answer these questions
from other members on NexusFi?
ZombieSqueeze
Platforms and Indicators
MC PL editor upgrade
MultiCharts
Exit Strategy
NinjaTrader
Better Renko Gaps
The Elite Circle
Pivot Indicator like the old SwingTemp by Big Mike
NinjaTrader
 
Best Threads (Most Thanked)
in the last 7 days on NexusFi
Just another trading journal: PA, Wyckoff & Trends
36 thanks
Tao te Trade: way of the WLD
24 thanks
Spoo-nalysis ES e-mini futures S&P 500
21 thanks
Bigger Wins or Fewer Losses?
19 thanks
GFIs1 1 DAX trade per day journal
16 thanks
  #102 (permalink)
 
kronie's Avatar
 kronie 
NYC + NY / USA
 
Experience: Advanced
Platform: "I trade, therefore, I AM!"; Theme Song: "Atomic Dog!"
Trading: EMD, 6J, ZB
Posts: 796 since Oct 2009


kronie View Post
win 7 x64 ultimate

actually the ramdisk lumps in the 4GB memory stick of the 8GB system memory, with all the other un-accessed memory of the 1st 4GB memory stick, and manages it as one block, surprisingly

fortunately I didn't go as far a BSOD, but the resulting system lock up caused the power button to be the only way of recovery and subsequent invokation of Ninja to be avoided, effectively locking up the system

either way to Sunday, these are in the hind-sight mirror a few miles back.

worthy of note, because Ninja is not consistent and has not been in their reference to files and locations within their directories and sub-directories, simply moving enmasse entire sub-components of these directories does not work. Junctions of a higher level directory "in theory" makes access to any lower level directory redirected. Because of the direct references in code, xml and other means within their code, and other templates, processes and schemas, its next to impossible to move the "bin" master directory to ram. By extention, its impossible to move the entire NT directory structure to ram. However, because of indirect access to the "\db" directories, moving that entire master directory works almost without problems.


more findings to be released, I'm 85% there.



one thing I noticed is when launching or changing or initalizing / serializing a workspace, Ninja gets stuck in a repetitive loop without handlers and as such will remain there adnauseum or for hours unless forced shutdown. watching the handlers and processes shows that pattern

strangest thing happens.....

if you care to look, you'll see and probably confirm that inspite of the "junction" to the highest level directory "\db", Ninja, creates a HDD copy of the "\db" in the C:\%userprofile%\My Documents\NinjaTrader7\db folder all over again.

I am not sure whether its using the redirect (junction) or thinking that nothing exists and starts polling for data a new from the rithmic servers, hence backfilling all missing current tick, minute, day data, thus accounting for the delayed initial start-up.

I am convinced its using the [RamDisk]:\\db (junction) because of the speed at which partial control is returned, and partial fleshing out of the complex charts on the workspaces occurs.

It is regrettable that I will need to dumb down the workspace to an acceptable level that balances speed of loading with usage with availability.

After all, what's the benefit of a finely tuned Lamborgini only to drive over potholes? What's the benefit of having a ninja tuned and tweaked to perfection, only to miss live trading opportunities. The objective is balance with an emphasis on making money!, whether using $5 interval contraacts or $10 interval, or $12.50 or $25 interval contracts.

this may be a case where subsequent loads of the up to date database will load all workspaces faster, than the initial time

Reply With Quote
  #103 (permalink)
 
ratfink's Avatar
 ratfink 
Birmingham UK
Market Wizard
 
Experience: Intermediate
Platform: NinjaTrader
Broker: TST/Rithmic
Trading: YM/Gold
Posts: 3,633 since Dec 2012
Thanks Given: 17,423
Thanks Received: 8,425


For most users I do not see the point in risking/working with RAM disk drives etc, they will see an order of magnitude greater improvement simply by going to Control Panels->System->Admin Tools->Services, double clicking on WindowsSearch and selecting Disable (it will normally be showing Automatic or Started), don't bother using Stop it will usually object. It will desist in its own time or after a reboot.

Checking in the Resource Manager before (if you can see SearchIndexer.exe in the list) and after you will never have seen your disk so quiet.

(Also the Ninja db node rebuild is a documented restart/fresh installation behaviour.) Deleting the db tree will get you a fresh (empty of user changes ...) database. Deleting any of the other sub folders in there is fine, if you don't need the historical data.

edit: just searched and spotted DT has mentioned this already in:

Travel Well
Visit my NexusFi Trade Journal Reply With Quote
Thanked by:
  #104 (permalink)
 
kronie's Avatar
 kronie 
NYC + NY / USA
 
Experience: Advanced
Platform: "I trade, therefore, I AM!"; Theme Song: "Atomic Dog!"
Trading: EMD, 6J, ZB
Posts: 796 since Oct 2009


ratfink View Post
For most users I do not see the point in risking/working with RAM disk drives etc, they will see an order of magnitude greater improvement simply by going to Control Panels->System->Admin Tools->Services, double clicking on WindowsSearch and selecting Disable (it will normally be showing Automatic or Started), don't bother using Stop it will usually object. It will desist in its own time or after a reboot.

Checking in the Resource Manager before (if you can see SearchIndexer.exe in the list) and after you will never have seen your disk so quiet.

(Also the Ninja db node rebuild is a documented restart/fresh installation behaviour.) Deleting the db tree will get you a fresh (empty of user changes ...) database. Deleting any of the other sub folders in there is fine, if you don't need the historical data.

edit: just searched and spotted DT has mentioned this already in:


those 2 tweaks are long past in the rear view mirror...

it is worth establishing a persistent (must be this type or its not worth losing your investment) ramdisk

moving the entire "\db" to ramdisk
establishing "junctions" on the primary and major sub-folders each
allowing for enough overall system memory (use no more than 67% available) or acquire more sticks...

it took a few reboots, to establish the pattern and let the system (both the win 7x64 and the ramdisk / junction / rebuild processes) learn, but once they did, I have never changed features on these workspaces so fast.

utto oh, ( [ Lyrics] Katy Perry - ROAR - Oficial Video - YouTube)


I feel a song coming on.....

Reply With Quote
  #105 (permalink)
 
kronie's Avatar
 kronie 
NYC + NY / USA
 
Experience: Advanced
Platform: "I trade, therefore, I AM!"; Theme Song: "Atomic Dog!"
Trading: EMD, 6J, ZB
Posts: 796 since Oct 2009

5-fold increase in speed,

I am achieving things never thought possible with NT7, namely on one workspace that has 9 charts (each having at least 2 panels; one having 5 panels, one having 8 panels) and each panel having analytics was able to load, and while loading, some price charts became active while others were loading and I was able to change the linked T&S/Static Dome symbol and it actually changed before the entire workspace became fully active.

true multitasking, imagine that!

can't wait for NT8

I hear they'll have features like:
A) Tools\Options\Reset Live trades, just like the reset sim101 trades, now
B) a "kick yourself" button
C) a "print profits" strategy button

Reply With Quote
  #106 (permalink)
 user33 
ny, ny
 
Posts: 23 since Apr 2010

I have been junctioning the db folder (only) to softPerfect RAMDISK for over 6 months now, it had never had a single problem.

OS is W7 x64 ultimate, 16GB RAM, 128GB Samsung SSD, i5-3.9Ghz CPU

Reply With Quote
  #107 (permalink)
 Guss   is a Vendor
 
Posts: 138 since Aug 2011
Thanks Given: 60
Thanks Received: 86


Beljevina View Post
@Guss, For the benefit of others, reading this perhaps down the road, were you able to make your situation better?

Thanks just saw your post.
haven't tried Ramdisk, just managed to play around with my charts

Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
  #108 (permalink)
 
kronie's Avatar
 kronie 
NYC + NY / USA
 
Experience: Advanced
Platform: "I trade, therefore, I AM!"; Theme Song: "Atomic Dog!"
Trading: EMD, 6J, ZB
Posts: 796 since Oct 2009

would be nice to hear from others on this topic of how they have implemented RamDisk for Ninja specifically

Reply With Quote
  #109 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,440 since Jun 2009
Thanks Given: 33,215
Thanks Received: 101,599


kronie View Post
would be nice to hear from others on this topic of how they have implemented RamDisk for Ninja specifically

This 10 page thread isn't enough?

I advise against the ramdisk, I ran into problems that corrupted NinjaTrader. Read the thread for more info.

Mike

We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on Twitter Visit my NexusFi Trade Journal Reply With Quote
  #110 (permalink)
 Futures Operator 
New York, NY
 
Experience: Intermediate
Platform: Sierra Chart, thinkorswim
Broker: Amp-Rithmic/TT, IB
Trading: CL, GC, NQ
Posts: 601 since Nov 2010
Thanks Given: 2,039
Thanks Received: 258


Not sure how it would translate over to NT, but for Sierrachart the engineers have stated that compared to a fast SSD, it makes no performance difference, other than perhaps marginally for initial loading of large files, but even that happens very quickly in a couple seconds, and only on initial startup. Not worth the stability risks.

Reply With Quote




Last Updated on August 6, 2020


© 2024 NexusFi™, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Downloads - Top
no new posts