I was wondering if there is any way to work with arbitrary http response data from the web, like rss feeds, twitter or facebooks apis, or even just the html or json response data from a request? Trying to work with some unconventional data sources and urllib is blocked.
Hi Richard,
Not today, but that is definitely the kind of thing we envision in the long run. Today, your best tact is to run whatever processing you want on your own server and tee up the final product in a csv.
We are working with vendors such as StockTwits and Accern who provide data feeds based on some of those web sources. Check out the forums for those examples to get a sense of our short term direction when it comes to working with external data.
Are there specific problems your trying to tackle or types of data you're especially interested in bringing in? One approach might be to roll your own (as you suggest) or but there might be vendors that focus on this type of thing today.
Thanks
Josh
Disclaimer
The material on this website is provided for informational purposes only and does not constitute an offer to sell, a solicitation to buy, or a recommendation or endorsement for any security or strategy, nor does it constitute an offer to provide investment advisory services by Quantopian. In addition, the material offers no opinion with respect to the suitability of any security or specific investment. No information contained herein should be regarded as a suggestion to engage in or refrain from any investment-related course of action as none of Quantopian nor any of its affiliates is undertaking to provide investment advice, act as an adviser to any plan or entity subject to the Employee Retirement Income Security Act of 1974, as amended, individual retirement account or individual retirement annuity, or give advice in a fiduciary capacity with respect to the materials presented herein. If you are an individual retirement or other investor, contact your financial advisor or other fiduciary unrelated to Quantopian about whether any given investment idea, strategy, product or service described herein may be appropriate for your circumstances. All investments involve risk, including loss of principal. Quantopian makes no guarantees as to the accuracy or completeness of the views expressed in the website. The views are subject to change, and may have become unreliable for various reasons, including changes in market conditions or economic circumstances.
Accern looks to be almost exactly what I was looking at doing, however if I'm not mistaken fetcher also has the limitation of only retrieving data once per day before market open. Is there any plan to incorporate any live data capability? If I were to set up my own web crawler that constantly looks for "sure thing" news articles on popular financial news sites, would I ever be able to fire off a command to my Quantopian bot to act on that info in real time?
Please sign in or
join Quantopian to
post a reply.
Need help?
Contact support.
Company
Learn & Support
Notices
Follow Us
The material on this website is provided for informational purposes only and does not constitute an offer to sell, a solicitation to buy, or a recommendation or endorsement for any security or strategy, nor does it constitute an offer to provide investment advisory services by Quantopian.
In addition, the material offers no opinion with respect to the suitability of any security or specific investment. No information contained herein should be regarded as a suggestion to engage in or refrain from any investment-related course of action as none of Quantopian nor any of its affiliates is undertaking to provide investment advice, act as an adviser to any plan or entity subject to the Employee Retirement Income Security Act of 1974, as amended, individual retirement account or individual retirement annuity, or give advice in a fiduciary capacity with respect to the materials presented herein. If you are an individual retirement or other investor, contact your financial advisor or other fiduciary unrelated to Quantopian about whether any given investment idea, strategy, product or service described herein may be appropriate for your circumstances. All investments involve risk, including loss of principal. Quantopian makes no guarantees as to the accuracy or completeness of the views expressed in the website. The views are subject to change, and may have become unreliable for various reasons, including changes in market conditions or economic circumstances.