06-reference/research

lo 2002 sharpe standard error autocorrelated fat tailed

2026-10-29·research-brief·source: deep-research·by Ray Data Co (deep-research synthesis)
sharpe-ratiostandard-errorsealed-holdoutvolatility-clusteringstrategy-discovery

At a 0.5 Sharpe gap, L_min is 8x to 11x the policy's 1,000 bars; nearly all of that is plain iid noise, and the small non-iid remainder is variance dependence rather than autocorrelation or unconditional fat tails

The question

"Verify the Lo (2002) Sharpe standard-error arithmetic under autocorrelated, fat-tailed daily returns rather than the iid approximation — how much longer than 1,000 bars does L_min actually need to be?"

This closes open-follow-up #4 of [[2026-08-31-sealed-holdout-refresh-policy]], which set the sealed-holdout queryability threshold at L_min = 1,000 daily bars and labelled its own supporting arithmetic "an optimistic floor" because it assumed independent and identically distributed (iid) returns.

What we already know (from the vault)

What the web says

Convergences and contradictions

Synthesis for RDCO

The answer to the question asked, simulated at the GARCH parameters fitted to our own cached SPY rather than at assumed ones. Across the four data-fitted variants (full-window and ex-COVID fits, each with the measured and the literature rho), the Monte Carlo standard-error curves run from SE = 13.70 * T^-0.4810 to 11.52 * T^-0.4483 against the iid 15.94 * T^-0.4999. Solving for 95 percent two-sided significance and 80 percent power, L_min to resolve an annualized-Sharpe gap of 0.50 is 8,300 to 10,910 bars, 32.9 to 43.3 years, i.e. 8.3x to 10.9x the policy's 1,000 bars. An earlier version of this brief put the range at 13x to 24x by simulating assumed parameters at GARCH persistence 0.99; our own fits come out at 0.962 and 0.970, and persistence is the main driver, so those figures belong in a sensitivity row rather than the headline. Held as sensitivity: persistence 0.99 at alpha=0.09/beta=0.90 gives 12,967 bars (13.0x) and at alpha=0.15/beta=0.84 gives 24,682 bars (24.7x). The decomposition matters more than the multiple. On a log scale 87 to 98 percent of the gap is plain iid sampling noise: the iid requirement is already 7,985 bars, 8.0x the policy's L_min, before any dependence is modelled. The departure from iid contributes only 1.04x to 1.37x on fitted parameters (1.62x to 3.09x on the higher-persistence sensitivity cases), and that is net of an AR(1) leg running the other way at 0.86x. So volatility clustering is the culprit for the departure from iid, and the departure is modest; the gap itself is overwhelmingly the iid arithmetic the parent brief already had. The parent's "optimistic floor" label was correct, and its stated reason was correct too: variance dependence is itself an iid violation, so nothing it wrote needs retracting. What this brief adds is which violation dominates, that the dominant one is invisible to both corrections the follow-up named, and that it is smaller than the headline framing implied. The choice of a 0.50 gap is ours, not the parent's: across d in {0.25, 0.50, 0.75, 1.00, 1.50} the multiple runs 35x to 51x, 8.3x to 10.9x, 3.6x to 4.4x, 2.0x to 2.3x, and 0.8x to 0.9x. Two honesty notes: this is a Monte-Carlo-fitted result, not a closed form, and the simulation grid stops at T=10,080, so the 0.50 answer sits at or just beyond the grid edge while the 0.25 answer extrapolates several-fold past it.

Turn it around and the indictment is sharper than any L_min number, and it does not depend on the GARCH parameterization at all. At the policy's 1,000-bar L_min the smallest annualized-Sharpe gap resolvable at 95/80 is 1.38 to 1.46 on the fitted specs, and 1.41 even under pure iid. SPY's own realized Sharpe over the cached window is 0.548. The holdout at its own queryability threshold can only detect an edge roughly 2.5x to 2.7x the size of the entire thing being traded. Across the whole 1,500-bar cache it is 1.14 to 1.22, still 2.1x to 2.2x SPY's Sharpe. Because the iid leg dominates, tightening the dependence model cannot rescue this. The undefined "materially higher Sharpe" in wet-rehearsal Bar 3 therefore has an implied floor nobody chose: whatever the holdout can resolve, which is a gap larger than the benchmark's own Sharpe. A pre-registered binary verdict set anywhere inside that band is a coin flip dressed as a gate, and the coarsening argument from the parent brief does nothing about it, because coarsening limits what the holdout leaks, not what it can resolve. One further asymmetry favours false passes: our Monte Carlo shows the naive annualized Sharpe carrying a finite-sample upward bias of +0.26 at T=300 and +0.16 at T=1,000 under SPY-like dynamics, which the power calculation above does not account for.

Three corrections to what the pipeline was likely to build, one of them a reversal of our own first pass. First, the robust time-aggregated estimator at q=252 is close to a wash, not clearly negative, and should be settled by Lo's pre-test rather than by the efficiency arithmetic. Lo's Eq 27 evaluated at SPY's measured Sharpe of 0.548 gives a variance ratio of 1.099, a 4.9 percent wider standard error, against a 7.3 percent narrower standard error from the rho of -0.076. We initially read this as net negative by evaluating Eq 27 at an assumed Sharpe of 1.0 (where the cost is 15 percent); at the measured Sharpe the comparison flips. The reason not to use it is simpler and is Lo's own: Ljung-Box does not reject on the ex-COVID series, so there is no established autocorrelation to correct. Note also that the 7.9 percent eta(252) figure is a point-estimate bias, a different quantity from a standard-error gain, and the two should not be netted against each other. Second, do not use a Mertens or Probabilistic-Sharpe plug-in standard error here. It buys 2 percent at daily frequency, it requires a fourth moment our own fitted parameters say is infinite, and its kurtosis input moves by a factor of 2.7 on the real data depending on one 50-day window. Use the Ledoit-Wolf studentized circular-block bootstrap, which is studentized rather than plug-in; their paper hands over the two-sample case and leaves the single-Sharpe extension to the reader. Third, retire L_min as a queryability threshold rather than raising it, because no reachable value makes the query informative, and replace it with a pre-registered power requirement computed per query.

What to build instead, and the tension in it. The paired difference against buy-and-hold is the only route within an order of magnitude of our data, and wet-rehearsal Bar 3 is already specified that way, so this is a cheap amendment rather than a redesign. Testing a candidate against the benchmark on the same bars collapses the standard error through the cross-correlation: computed by us from the Jobson-Korkie/Memmel variance on a consistent closed-form iid basis (7,927 bars for the single-Sharpe case, against the 7,985 the simulated iid control gives), L_min for a 0.50 gap falls to 1,589 bars at a return correlation of 0.90 and 797 at 0.95. Our Monte Carlo confirms the benefit survives GARCH but is materially eroded by it, giving roughly 2,450-2,770 bars at correlation 0.90 and 1,615-1,846 bars at 0.95. Under realistic dynamics no tested correlation fits inside the 1,500-bar cache; the 0.95 case needs 6.4 to 7.3 years against the 5.98 available, so this route is close but not yet reachable, and it becomes reachable with roughly one more year of accrual. The tension to name rather than hide is that correlation and edge trade off: a candidate 95 percent correlated with SPY is very nearly SPY, so the regime where the test has power is the regime where the difference being tested is hardest to generate. The amendment to Bar 3 is therefore to pre-register the expected candidate-benchmark correlation alongside the Sharpe gap, compute the required bars from the pair, and refuse the holdout query when the pre-registered pair is unresolvable on the block, which makes the gate's own power an auditable pre-registered quantity. Cross-sectional sealing helps less than the parent hoped, and we can now supply the discount it asked for: using N_eff = N/(1+(N-1)*cbar), 50 symbols at average pairwise correlation 0.50 give N_eff = 1.96, 100 at 0.35 give 2.81, 100 at 0.20 give 4.81. On the fitted-spec curve those reduce the 43-year requirement for a 0.50 gap to 20.4, 13.7 and 7.5 years, none reachable. Making a 0.50 gap resolvable on the existing 1,500 bars would need N_eff of 5.92, which requires average pairwise correlation below 0.17 across a large symbol set. Equities do not offer that within a regime. Breadth is a genuine 2-to-5x multiplier worth building, not a solution.

Why this is in the vault

This closes open-follow-up #4 of [[2026-08-31-sealed-holdout-refresh-policy]] and changes three specific build inputs for validation/holdout.py in /Users/ray/Projects/automated-investing: L_min = 1,000 daily bars is retired as a queryability threshold in favour of a per-query power requirement; wet-rehearsal Bar 3's undefined "materially higher Sharpe" gains a pre-registered Sharpe gap plus an expected candidate-benchmark correlation, with the query refused when the pair is unresolvable on the block; and the standard error is computed by studentized block bootstrap rather than a Mertens or Probabilistic-Sharpe plug-in. It also supplies the effective-independence discount that brief left unspecified for cross-sectional sealing (N_eff caps at roughly 2 to 5, needing 5.92 to close the gap), and it rules out Lo's robust q-aggregated estimator at q=252 on Lo's own Ljung-Box grounds rather than on the efficiency argument our first pass used.

Open follow-ups

Related

Sources

Vault:

Repo and data (verified 2026-10-29):

Computed by us (scripts and raw output in /Users/ray/scratch/sharpe-se/, seeded and reproducible):

Web: