In 15 ds006253 SEEG patients, 30-trial CV ranked final AUC but did not forecast its value better than the patient mean
Using archived 70–150 Hz high-gamma features from 15 patients in OpenNeuro ds006253, we evaluated whether early calibration predicts held-out movement-detector AUC after full calibration. At 30 trials, five-fold cross-validation ranked final AUC (Spearman rho = 0.76, Holm-corrected p = 0.002), but its absolute error (0.070) was not lower than the mean of the other patients (0.075; Holm-corrected p = 0.82). A power-law learning-curve extrapolation had MAE 0.063 and did not differ from cross-validation (Holm-corrected p = 0.82). At 20 trials, early forecasts had greater error than the patient mean; at 40 trials, errors were similar. These findings support using early cross-validation to rank or triage patients, not to state an individual patient’s final AUC. The analysis used one task, one shrinkage-LDA decoder, archived author high-gamma features, and 15 patients; MOVE and REST windows occurred at different task times, and final AUC was estimated from 48–120 held-out trials.
brain-computer interface · stereo-EEG · high-gamma activity · movement decoding · AUC · early prediction · cross-validation · shrinkage LDA · learning curves
References
4- usesIn a second SEEG dataset, 8 ranked channels retained 95% of movement detection gain, while random subsets required 64 sci:sha256:57b4308b72da1a45b82f882818aa9800e5f0d2e20c61685ea25f9640e506241b
Source of the 15-patient ds006253 HGA feature files, provenance and decoder code.
- usesA pre-registered test found movement decoding in five additional ds006253 patients, with mean held-out AUC 0.874 sci:sha256:5b7e7453bf9d35bc1113c364ab3daac7fd7cdc393cb61b160586cbaf516dc375
Origin of the shrinkage-LDA movement detector and feature definition; the final mean AUC 0.833 reproduces its value.
- Early power-law learning curves did not improve 100-trial SEEG decoder forecasts over cross-validation in eight subjects sci:sha256:24ceb97fd48c4a13d892cce198fa70131d29d9dc8e1aac2647d64d63dfc6e3a6
[Legacy relation: reproduces] Same question in a second dataset (ds006253, 15 patients): a power-law fit did not beat early CV, and early CV did not forecast the final AUC value well.
- usesdoi:10.18112/openneuro.ds006253.v1.0.3
Source dataset for the archived 70–150 Hz HGA features and behavior of 15 patients analyzed here; the recorded source is OpenNeuro ds006253 version 1.0.3.
Cited by
0 publicationsPublic catalog entries on Sciscape.
No incoming citations on Sciscape.