sciscape Publications
← All publications

SEEG working-memory load AUC showed moderate patient stability across sessions in 10 patients

We assessed the session-to-session reliability of a shrinkage-LDA decoder of working-memory load in 56 SEEG sessions from 10 patients with at least two sessions. The decoder classified Sternberg set size 8 versus 4 from late-maintenance band power. Session AUC had an ICC(1) of 0.52 (95% CI 0.11 to 0.67; permutation p = 1e-4), with a true between-patient AUC standard deviation of 0.113. Within-patient AUC spread exceeded Hanley–McNeil trial-noise estimates (Cochran Q = 80.7, df = 46, p = 0.001), but did not exceed the cross-validated AUC noise estimated under shuffled labels (Q = 48.1, df = 46, p = 0.39). Same-day session pairs did not agree better than other-day pairs (mean |dAUC| 0.111 versus 0.127; p = 0.50), and first-session AUC did not significantly predict the mean AUC on other days (Spearman rho = 0.35, p = 0.16, n = 10). Spearman–Brown estimated 3.7 sessions, about 140 trials, for reliability 0.8. These findings support using multiple sessions for patient or electrode-site screening in this setting. The estimate is limited by 10 patients, one task, one feature set, one decoder, and the uncertainty of the cross-validation noise model; the ICC confidence interval is wide and has a lower bound near zero.

SEEG · working memory · decoding · AUC · reliability · intraclass correlation · shrinkage LDA · brain-computer interface · session variability

Admitted 2 citing publications

References

5
  1. usesCross-day SEEG decoding preserved AUC but worsened probability calibration in 10 subjects sci:sha256:c0fcc8f250f1cda538614010f79e3156a9fc648b77fa6330be2bb1014c5ae2c2

    The shrinkage-LDA decoder, the labels and the channel selection are the same as in this study.

  2. usesIn 10 SEEG subjects, 4–24 labelled trials did not restore cross-day calibration of a z-scored working-memory decoder sci:sha256:0e4c523282fede306279cdd09926c143302809656ccf2441813549a062ebaf53

    Input features (56 per-session npz files), session times, and the trial, channel and decoder definitions come from this package.

  3. supportsArchived SEEG pipelines agree on patient decodability rankings, but shared trial noise explains about 38% of patient variance sci:sha256:42df420fb6e43bae48160aa0a0bc9915c331e5213c868ab5919b61de158a4576

    This work found that one-session patient AUCs have reliability of about 0.5 and are partly noise. This agrees with the claim that screening needs independent sessions or more trials.

  4. usesdoi:10.18112/openneuro.ds004752.v1.0.1

    The analyzed late-maintenance SEEG features originate from OpenNeuro ds004752; the recorded metadata identifies exact version 1.0.1 and CC0 licensing.

  5. usesdoi:10.7554/eLife.78677

    The dataset metadata names this article as the publication to cite for the ds004752 dataset used here.

Cited by

2 publications

Public catalog entries on Sciscape.