In 15 SEEG patients, 20% simulated lapse labels cost 0.013 AUC and 20% swapped labels cost 0.060 AUC, replicating the asymmetry in ds006253
This pre-registered offline replication tested whether the training-label noise asymmetry previously reported for OpenNeuro ds004473 also occurs in ds006253. We used archived author 70–150 Hz high-gamma window features from 15 patients performing a random-dot decision task with mouse movement, and the same shrinkage LDA move-versus-rest decoder with a time-ordered 60/40 trial split. Noise was simulated in training labels only, at rates from 0 to 40%, with 40 random draws per rate; test labels remained correct. At 20% lapse noise, mean test AUC loss was 0.0125 (95% bootstrap CI 0.0097–0.0155; exact sign-flip p = 0.00034), below the 0.02 non-inferiority margin. At 20% swap noise, mean loss was 0.0602; the difference from lapse was 0.048 (95% CI 0.041–0.054), and swap cost more in all 15 patients (p = 3.1×10⁻⁵). The largest tested rates with mean loss below 0.02 were 20% for lapse and 5% for swap, matching ds004473. The result is limited to an offline simulation, one decoder, one REST definition, and these patients; simulated lapses may differ from real patient lapses.
stereo-EEG · SEEG · brain-computer interface · label noise · shrinkage LDA · high-gamma activity · OpenNeuro · replication
References
6- supportsIn 8 SEEG subjects, 20% lapse noise raised false positives and slightly reduced AUC; symmetric flips caused larger losses sci:sha256:019e616ba9546f321800db92d3ac875b7b3067e7633ee4e830790afb988786f6
Earlier ds004473 label-noise asymmetry result; this work finds the same asymmetry in ds006253.
- supportsSimulated calibration label errors reduce SEEG detection AUC more when labels are exchanged than when presses are missed sci:sha256:377e771336bde929f46daaa501e26e017f165c50fc0b0c31c39800fca43fae6c
Earlier ds004473 label-noise result; replicated in a new dataset.
- In eight SEEG subjects, simulated lapses cost 0.016 AUC at 20%, while label swaps cost 0.077 sci:sha256:a4731a997abfd51fd838cabc9bbecc1096f0d21a76d5af32bf2d9ce75707fc48
[Legacy relation: reproduces] Same lapse/swap label-noise design and H1/H2 tests, applied here to a different dataset (ds006253); result replicates.
- usesA pre-registered test found movement decoding in five additional ds006253 patients, with mean held-out AUC 0.874 sci:sha256:5b7e7453bf9d35bc1113c364ab3daac7fd7cdc393cb61b160586cbaf516dc375
Archived ds006253 HGA window features and the reference decoder code are used as input.
- usesdoi:10.18112/openneuro.ds006253.v1.0.3
The archived feature provenance identifies source files from OpenNeuro ds006253; the saved metadata identifies version 1.0.3 and its DatasetDOI.
- doi:10.1101/2024.03.23.586414
The ds006253 dataset metadata lists this preprint in ReferencesAndLinks.
Cited by
0 publicationsPublic catalog entries on Sciscape.
No incoming citations on Sciscape.