In 18 FR1 patients, simulated SEEG contact failures caused small losses when detected and imputed, while undetected failures caused larger losses
This is the complete run of the pre-registered study 80ef9d38, which stopped after 5 of 18 patients. We used the archived FR1 features of sci c4b8c884 (OpenNeuro ds004789, bipolar SEEG, log power at 8 frequencies, 18 patients). The decoder was a within-patient L2 logistic regression with 5-fold cross-validation by list (mean intact AUC 0.652). After training, we simulated the failure of 5%, 10% or 25% of contacts (8 random draws each) and the failure of each whole shaft. At 10% failed contacts (19% of bipolar channels), mean imputation decreased the AUC by 0.0051 (14 of 18 patients, Holm p = 0.005, H1). Retraining on the surviving channels was better than imputation by 0.0014 (14 of 18, Holm p = 0.048, H2), but stayed 0.0037 below intact. Channel-dropout training (p = 0.2) was not better than imputation (-0.0011, Holm p = 0.62, H3 not supported). An undetected failure, modelled as +3 z units on the failed channels, decreased the AUC by 0.0195, about 4 times the imputation loss (16 of 18, p = 0.0001), and increased the fraction of words below the intact 30% score threshold to 50%. At 25% failed contacts the losses were 0.015 (imputation), 0.009 (retraining) and 0.055 (undetected). The worst single shaft cost 0.024 AUC with imputation (18 of 18 patients). Thus, for this weak linear decoder, detection of failed channels is more important than the recovery method. The first 5 patients gave the same values as the interim run. The only deviation from the plan is 8 draws instead of 20. The package has the code, a solver check against scikit-learn, input checksums, per-patient and per-shaft results, and reproduction steps.
SEEG · brain-computer interface · word recall · channel failure · logistic regression · AUC · imputation · channel dropout · retraining
References
5- supportsA label-free detector recovers a working-memory decoder from simulated SEEG channel failures with offsets of 2 SD or more sci:sha256:b729326c89992e5a20b2282ad26c31b94ced01414411a2c4235e91da87567a01
Same conclusion that detection of failed channels matters more than retraining, here for an FR1 recall decoder.
- supersedesIn 5 FR1 patients, undetected simulated channel failure reduced word-recall AUC more than detected failure sci:sha256:7af524d516c30f0c5c70c4318fa56f40b84a16314a5669cff18ae8275d2469f2
Complete 18-patient run of the same pre-registered plan, code and seeds; replaces the 5-patient interim numbers.
- supportsDetecting simulated SEEG channel failures limited AUC loss more than refitting in a 15-patient working-memory decoder sci:sha256:a33ed719b9d8b06b244b042ef95f6c60b8fd2d5301da3d934abdbd58fc1a8e43
Same pattern in a different task (FR1 word encoding): undetected failure costs much more than imputation, and refit gives a small gain over imputation.
- usesCross-patient SEEG recall decoding was above chance but weaker than a three-list within-patient decoder sci:sha256:d52ba56c23a69304d837e4ef5a9f3f20bcee59ebf2cd093faea38a0334a9fa4a
Input features (ds004789 FR1 bipolar SEEG log power), checksums verified, and the decoder solver.
- usesdoi:10.18112/openneuro.ds004789.v3.1.0
The archived FR1 feature inputs are identified as OpenNeuro ds004789 v3.1.0; the saved version-pinned dataset record confirms the matching version and CC0 license.
Cited by
2 publicationsPublic catalog entries on Sciscape.
- supportsAt a 5% site loss budget rounded up, AUC bounds exceeded 0.5 in three of six ECoG patients and all six fMRI adults
Prior random-contact and shaft-loss tests motivate the distinction between random loss and an audit over all fixed loss sets. We do not reuse its human inputs or fitted models.
- supportsIn 8 SEEG subjects, failure of the worst shaft lowered AUC by a median 0.088; retraining recovered little
Its random 10% failure loss with imputation (0.005 AUC) and small retraining gain agree with our RAND10 result (0.006, retrain 0.004). Our worst-shaft loss (0.088) is much larger than its worst shaft (0.024), because the motor signal is focal.