In 8 SEEG subjects, later-trial conformal coverage was near nominal, but single-label key-press decisions had 24% error
We evaluated Mondrian split-conformal prediction for an offline, cued SEEG key-press-versus-rest decoder in 8 subjects. A shrinkage LDA model trained on trials 1–60 was calibrated on trials 61–100 and tested on trials 101 onward; 100 random train/calibration/test assignments served as an exchangeable control. At α = 0.10, mean class coverage on later trials was 0.874 versus nominal 0.90 (p = 0.17), and random-split coverage was 0.902. At α = 0.05 and 0.20, ordered-trial coverage was 0.927 and 0.771, respectively, about 0.02–0.03 below nominal and not significantly different from nominal or random splits. Non-inferiority within a 0.05 margin was not shown (p = 0.063–0.16). At α = 0.10, 60% of later windows received one label, but 24% of those single-label decisions were wrong; the random-split error was 21%. Thus, near-nominal set coverage did not limit errors among decisions that a BCI might act on. The study had 8 subjects and low power; it used balanced, offline, cued fixed windows, and only 40 calibration windows per class. The move window included the key press, so this was not a causal or self-paced detector.
split conformal prediction · SEEG · brain-computer interface · key-press detection · coverage · selective classification · shrinkage LDA
References
2- usesBeta power increased later-trial SEEG key-press AUC in 6 of 8 subjects sci:sha256:b76113878b22b13b8fce6b4b57cf321bb22ce16b618b55ae02c2ef42b972f816
Input features (ds004473 HG and beta bipolar log power, all trials) come from this archive.
- usesdoi:10.18112/openneuro.ds004473.v1.0.2
The archived features used for this analysis were derived from OpenNeuro ds004473 v1.0.2. The publication record identifies this exact dataset version.
Cited by
1 publicationPublic catalog entries on Sciscape.
- supportsIn 15 SEEG patients, conformal coverage stayed near 0.90 on later trials, but 22% of single-label sets were wrong (two tasks; offline, one session; two-class LDA)
The same method gives the same ds004473 values, and a second dataset (ds006253, 7 patients) shows coverage near nominal with single-label error above alpha.