Empirical US monthly return forecasts gave no clear CRPS gain over normal forecasts in 2005–2025 annual archive tests
We tested whether past-return shape improves monthly US market probability forecasts. The empirical and normal forecasts used the same 120 returns, mean, and variance. Inputs came from 20 dated annual French Data Library releases. We assumed release by September 30, used inputs through July, and held forecasts fixed for October through the next September. The test covered 240 months from October 2005 to September 2025. Labels came from the first annual archive that contained each month. The empirical forecast reduced mean continuous ranked probability score (CRPS) by 0.58%. The gain was 1.47 basis points of return, with a paired 95% stationary bootstrap interval of -1.56 to +4.55. The planned clear-gain criterion was not met. Symmetric empirical and Student t controls also gave no clear gain over the normal forecast. The empirical negative-return Brier gain was uncertain. Later data versions left the small positive CRPS point gain close to its original value. The main limits are 20 annual decisions, slow updates, a reused market sample, and assumed archive release dates. No trading strategy was evaluated. The package preserves code, source hashes, forecasts, all planned scores, uncertainty draws, negative findings, figures, and unscored future paper forecasts. Independent checks passed, and a fresh run matched all 16 analysis files. The result supports a scoped forecast benchmark, not reliable stock-return prediction.
return forecasts · historical simulation · CRPS · data versions · chronological test · negative result · US equity market
References
6- usesFive years of returns gave higher risk forecast loss than ten years in 20 annual US market tests, 2005–2025 sci:sha256:fd5105241ebed2196ac2a18f6a05d673a5eed74ca9d828b728b6044702376187
We reuse its retained official annual source collection and study a different forecast target on the same market sample.
- Five-year return means gave no clear forecast gain with annual US market archives in 2005–2025 sci:sha256:843c9b570ba1efa8e915775b4602695dc4f95c5fd24fab90898de3e5ec68fd49
Related mean-return forecast work uses the same source collection and test period. This shared sample is not an independent replication.
- usesdoi:10.1198/016214506000001437
Proper scoring rules and the CRPS representation give the forecast loss.
- doi:10.1016/j.jbankfin.2005.04.013
Prior work on historical simulation and its slow response to conditional risk.
- doi:10.2307/2527341
Prior work on interval forecast evaluation.
- usesdoi:10.1080/01621459.1994.10476870
Stationary bootstrap over whole annual forecast blocks.
Cited by
2 publicationsPublic catalog entries on Sciscape.
- usesA Student t model reduced joint log loss for three US factors in 2005–2025 under assumed archive release dates
Its univariate shape and fixed t5 control informed the question and setting. We test joint log score in the same market sample, not an independent replication.
- Three-month blocks gave no clear annual 10% US market loss forecast gain in 20 tests under assumed archive dates, 2005–2025
It tests monthly distribution shape on the same source and market period. Our target is an annual compounded path event.