Quantopian's community platform is shutting down. Please read this post for more information and download your code.
Back to Community
[Issue/Bug report] Research Notebook Auto Restart

Hi, I am reporting an issue that the research notebook will auto-restart without any hint during my daily usage.

I loaded like 1000-2000 securities for 4-5 years, by querying get_fundamentals for 40-60 times (every time I only fetch one month's data otherwise the API is not responsible, throwing me connection error) . It takes like 20 seconds for one query and up to 10 mins to get all of them (4-5 years).

The initial memory usage is about 20% after loading. And it increased to around 50% or so after I did some manipulation and calculation. Sometimes at this stage (with around 50% memory usage), when I tried to do some other actions, the notebook crashed and auto restarted (memory usage back to 8%-10% after initialization) and all my working space is swiped. So I have to reload the data and recalculate everything I had got before this crash/auto-restart.

I know the notebook is in beta version and I think the developers may have some way to get my crash logs for more detailed information regarding this issue. Hopefully this issue can be fixed in the future.

1 response

Did anyone have the same issue? Basically the issue is, research notebook will restart occasionally when memory usage reaches some level. The crash threshold level in my experience can be as low as 40%, and as high as 70%. I never utilize more than 70% memory before notebook crashes.