Dear Experts,
I was simulating long/short algo using fundamental data and halfway , it stopped and showed out of memory.
I tried to use "del" to remove the variables but still doesnt work.
I thought at every re-balancing time, the program will re-use the variables and functions again by overwriting it.
Are there other ways to clean up the memory each re-balance period?
Thanks
L
When I used the following code to delete all variables at the end of "rebalance" function, I have this error, "Cannot use built-in function 'globals'"
for name in dir():
if not name.startswith('_'):
del globals()[name] Quantopian: Are you able to allow the access of this "global"
Any other idea?
It's probably the transaction logs which are taking up all the memory, not the variables you've stored.
is there a way to remove the transaction logs? The turnover falls within Quantopian contest criteria. Average holdings about 500.
One thing that can help a bit is to comment out any pipeline content in 'columns' if not used later. Often they are just used to arrive at alpha. I keep column content using pipeline overview during work until another time when I need to actually examine the numbers with my eyes.
How long generally before a backtest goes splat against the wall?
Earlier in a post I had commented speculating that Q keeping all orders for the duration of the backtest might be significant but I no longer think so. A 10 year backtest rebalancing 1000 stocks per day with all of those order objects as a string became only 50MB on the last day. I think backtesting is currently 8GB RAM.
The material on this website is provided for informational purposes only and does not constitute an offer to sell, a solicitation to buy, or a recommendation or endorsement for any security or strategy, nor does it constitute an offer to provide investment advisory services by Quantopian.
In addition, the material offers no opinion with respect to the suitability of any security or specific investment. No information contained herein should be regarded as a suggestion to engage in or refrain from any investment-related course of action as none of Quantopian nor any of its affiliates is undertaking to provide investment advice, act as an adviser to any plan or entity subject to the Employee Retirement Income Security Act of 1974, as amended, individual retirement account or individual retirement annuity, or give advice in a fiduciary capacity with respect to the materials presented herein. If you are an individual retirement or other investor, contact your financial advisor or other fiduciary unrelated to Quantopian about whether any given investment idea, strategy, product or service described herein may be appropriate for your circumstances. All investments involve risk, including loss of principal. Quantopian makes no guarantees as to the accuracy or completeness of the views expressed in the website. The views are subject to change, and may have become unreliable for various reasons, including changes in market conditions or economic circumstances.
