In 15 SEEG patients, 10% training-label flips reduced median held-out AUC by 0.047; the equal-sample rule was not confirmed
This cross-task replication tested whether the held-out AUC loss from symmetric training-label flips follows the (1−2p)² equal-sample rule in a verbal Sternberg working-memory load decoder. It used archived maintenance-period band-power features from 15 patients with SEEG, a shrinkage LDA decoder, and 20 repeats of stratified five-fold cross-validation; only training labels were changed. Clean median AUC was 0.663. With 10% of training labels flipped, median AUC decreased by 0.047 (95% CI 0.007–0.058; 12/15 patients; exact sign-flip p=0.004), about twice the 0.020 loss reported for an FR1 recall decoder. The decoder retained a median 81% of above-chance AUC among 10 patients with clean AUC above 0.55. Differences between flipped-label and equal-sample conditions were not statistically significant at p=0.10 or 0.20, but confidence intervals exceeded the prespecified ±0.02 AUC equivalence margin, so equivalence was not shown. Limits include simulated symmetric errors, one offline session per patient, 20–42 trials per patient, and five patients with little clear load signal. The recorded OpenNeuro URLs and hashes identify the source files; their exact immutable dataset release was not established.
SEEG · brain-computer interface · label noise · working memory · shrinkage LDA · AUC · cross-validation · calibration trials
References
2- In 18 FR1 SEEG patients, 10% simulated random label flips lowered median held-out AUC by 0.020; 20% exceeded the effective-sample rule sci:sha256:8a546b62db907957bd469106176e161781f3acdfae7a011a692e42f6140278e3
[Legacy relation: reproduces] Repeats its label-flip and (1-2p)^2 equal-sample test on a different SEEG task (ds004752 load), decoder (shrinkage LDA) and trial count.
- usesSEEG load decoding improves with channel count, while training fold selection adds a small and inconsistent gain sci:sha256:a1b1bdd0f518fbb2c2df6602d834b6e285ba787275d9c6aebd64474017c360b0
Archived ds004752 band-power features (data/feat), trial filter and shrinkage LDA code.
Cited by
1 publicationPublic catalog entries on Sciscape.
- usesIn 8 SEEG subjects, simulated lapses modestly reduced offline key-press AUC, and inner-CV self-cleaning did not recover it
Same flip simulation on another task; our flip loss in a motor detector is in the same range per wrong label.