144 signal tests, two winners, no edge
Failure type: overfit (no edge beyond chance). Verdict: a reason to look closer, not an edge.
The idea
Before building strategies, ask a simpler question: does any common indicator predict next-period returns on ETFs at all?
What we did
- 24 daily indicators (returns over several lookbacks, momentum, moving-average ratios, RSI, Bollinger z-score, drawdown from high, volatility, volume ratios).
- Each tested at 1-, 5- and 20-day horizons, two ways (per-ETF over time, and ranking ETFs against each other each day). That is 144 tests on 23 ETFs, training years 2005–2016 only.
- Guards against a broken pipeline: a "leakage canary" (feeding the answer in as an indicator must be flagged, and it was) and a null where labels are shifted in time (500 shifts).
What happened
Two tests passed a per-test false-discovery check (Benjamini–Hochberg, q = 0.10): the 5-day return and the 2-day RSI, both as short-term reversal signals at the 5-day horizon. Their predictive correlations (IC) were small: −0.061 and −0.046.
But the right comparison is the largest effect across all 144 tests against the largest you'd see by chance. It was not beaten: the biggest observed effect sat inside the noise (p = 0.22 for the per-ETF test, 0.38 for the cross-ETF test).
Why it failed
Test enough indicators and a couple will look significant. These two were small, and the family-wise null says that is what luck looks like. We treated the result only as "weekly reversal is worth a costed test", and that test is its own page.
Receipts: 144 trials were recorded in our trial registry.
Research and education only. These are paper results from historical data on a limited set of funds. Not investment advice, not a recommendation, not a prediction. See Legal.