SEEG working-memory load AUC showed moderate patient stability across sessions in 10 patients
We assessed the session-to-session reliability of a shrinkage-LDA decoder of working-memory load in 56 SEEG sessions from 10 patients with at least two sessions. The decoder classified Sternberg set size 8 versus 4 from late-maintenance band power. Session AUC had an ICC(1) of 0.52 (95% CI 0.11 to 0.67; permutation p = 1e-4), with a true between-patient AUC standard deviation of 0.113. Within-patient AUC spread exceeded Hanley–McNeil trial-noise estimates (Cochran Q = 80.7, df = 46, p = 0.001), but did not exceed the cross-validated AUC noise estimated under shuffled labels (Q = 48.1, df = 46, p = 0.39). Same-day session pairs did not agree better than other-day pairs (mean |dAUC| 0.111 versus 0.127; p = 0.50), and first-session AUC did not significantly predict the mean AUC on other days (Spearman rho = 0.35, p = 0.16, n = 10). Spearman–Brown estimated 3.7 sessions, about 140 trials, for reliability 0.8. These findings support using multiple sessions for patient or electrode-site screening in this setting. The estimate is limited by 10 patients, one task, one feature set, one decoder, and the uncertainty of the cross-validation noise model; the ICC confidence interval is wide and has a lower bound near zero.
SEEG · working memory · decoding · AUC · reliability · intraclass correlation · shrinkage LDA · brain-computer interface · session variability
References
5- usesCross-day SEEG decoding preserved AUC but worsened probability calibration in 10 subjects sci:sha256:c0fcc8f250f1cda538614010f79e3156a9fc648b77fa6330be2bb1014c5ae2c2
The shrinkage-LDA decoder, the labels and the channel selection are the same as in this study.
- usesIn 10 SEEG subjects, 4–24 labelled trials did not restore cross-day calibration of a z-scored working-memory decoder sci:sha256:0e4c523282fede306279cdd09926c143302809656ccf2441813549a062ebaf53
Input features (56 per-session npz files), session times, and the trial, channel and decoder definitions come from this package.
- supportsArchived SEEG pipelines agree on patient decodability rankings, but shared trial noise explains about 38% of patient variance sci:sha256:42df420fb6e43bae48160aa0a0bc9915c331e5213c868ab5919b61de158a4576
This work found that one-session patient AUCs have reliability of about 0.5 and are partly noise. This agrees with the claim that screening needs independent sessions or more trials.
- usesdoi:10.18112/openneuro.ds004752.v1.0.1
The analyzed late-maintenance SEEG features originate from OpenNeuro ds004752; the recorded metadata identifies exact version 1.0.1 and CC0 licensing.
- usesdoi:10.7554/eLife.78677
The dataset metadata names this article as the publication to cite for the ds004752 dataset used here.
Cited by
2 publicationsPublic catalog entries on Sciscape.
- usesIn one session of 15 patients, SEEG load decoders showed no clear cross-period transfer, while pooled training showed no significant loss
Shows that one session of about 34 trials gives noisy per-patient AUC. We use this to limit our claims to group-level tests.
- usesIn 15 SEEG patients, hippocampal sclerosis did not significantly lower verbal working-memory load decodability; large decreases remain unresolved
Per-session AUCs (results/session_auc.json) give the multi-session outcome S3.