Hello Shai,
How big is N? And what do you mean by "different trading signals"?
As is, the online version of Quantopian doesn't support backtesting in batches or a loop (except by manually running multiple versions of an algorithm in separate browser tabs). I haven't used it myself, but there is an offline version of the backtester called zipline (as I understand, a modified version of zipline is the engine for the online backtester). Zipline is available on https://github.com/quantopian/zipline, with a separate discussion group ([email protected] and https://groups.google.com/forum/#!forum/zipline). Also, see http://zipline.io/.
With zipline, you won't have access to the Quantopian data, but I gather that folks have been successful with free daily bars downloaded from Yahoo, etc. (e.g. https://www.quantopian.com/posts/zipline-in-the-cloud-optimizing-financial-trading-algorithms).
Note also that Thomas Wiecki (Quantopian employee) has been talking about developing optimization routines that would run on the online version of Quantopian. So, if you are looking to optimize a set of parameters in your algorithm, you might ask for his advice.
Grant