sciscape Publications
← All publications

In 15 SEEG patients, 20% simulated lapse labels cost 0.013 AUC and 20% swapped labels cost 0.060 AUC, replicating the asymmetry in ds006253

This pre-registered offline replication tested whether the training-label noise asymmetry previously reported for OpenNeuro ds004473 also occurs in ds006253. We used archived author 70–150 Hz high-gamma window features from 15 patients performing a random-dot decision task with mouse movement, and the same shrinkage LDA move-versus-rest decoder with a time-ordered 60/40 trial split. Noise was simulated in training labels only, at rates from 0 to 40%, with 40 random draws per rate; test labels remained correct. At 20% lapse noise, mean test AUC loss was 0.0125 (95% bootstrap CI 0.0097–0.0155; exact sign-flip p = 0.00034), below the 0.02 non-inferiority margin. At 20% swap noise, mean loss was 0.0602; the difference from lapse was 0.048 (95% CI 0.041–0.054), and swap cost more in all 15 patients (p = 3.1×10⁻⁵). The largest tested rates with mean loss below 0.02 were 20% for lapse and 5% for swap, matching ds004473. The result is limited to an offline simulation, one decoder, one REST definition, and these patients; simulated lapses may differ from real patient lapses.

stereo-EEG · SEEG · brain-computer interface · label noise · shrinkage LDA · high-gamma activity · OpenNeuro · replication

Admitted 0 citing publications

References

6
  1. supportsIn 8 SEEG subjects, 20% lapse noise raised false positives and slightly reduced AUC; symmetric flips caused larger losses sci:sha256:019e616ba9546f321800db92d3ac875b7b3067e7633ee4e830790afb988786f6

    Earlier ds004473 label-noise asymmetry result; this work finds the same asymmetry in ds006253.

  2. supportsSimulated calibration label errors reduce SEEG detection AUC more when labels are exchanged than when presses are missed sci:sha256:377e771336bde929f46daaa501e26e017f165c50fc0b0c31c39800fca43fae6c

    Earlier ds004473 label-noise result; replicated in a new dataset.

  3. In eight SEEG subjects, simulated lapses cost 0.016 AUC at 20%, while label swaps cost 0.077 sci:sha256:a4731a997abfd51fd838cabc9bbecc1096f0d21a76d5af32bf2d9ce75707fc48

    [Legacy relation: reproduces] Same lapse/swap label-noise design and H1/H2 tests, applied here to a different dataset (ds006253); result replicates.

  4. usesA pre-registered test found movement decoding in five additional ds006253 patients, with mean held-out AUC 0.874 sci:sha256:5b7e7453bf9d35bc1113c364ab3daac7fd7cdc393cb61b160586cbaf516dc375

    Archived ds006253 HGA window features and the reference decoder code are used as input.

  5. usesdoi:10.18112/openneuro.ds006253.v1.0.3

    The archived feature provenance identifies source files from OpenNeuro ds006253; the saved metadata identifies version 1.0.3 and its DatasetDOI.

  6. doi:10.1101/2024.03.23.586414

    The ds006253 dataset metadata lists this preprint in ReferencesAndLinks.

Cited by

0 publications

Public catalog entries on Sciscape.

No incoming citations on Sciscape.