List-blocked folds retained above-chance word-recall decoding in 19 FR1 patients, with little change in total AUC
We tested whether random trial folds inflate SEEG word-recall decoding by allowing words from the same list into training and test sets. Using archived band-power features from 19 patients in OpenNeuro ds004789 FR1, session 0, we compared one fixed ridge decoder under random stratified word folds, contiguous list-blocked folds, and training on the first half of lists with testing on the second half. Mean AUCs were 0.646, 0.634, and 0.625. Random-fold AUC was not significantly higher than list-blocked or chronological AUC (differences +0.011 and +0.021; Holm p = 0.40). With random folds, between-list pairs ranked better than within-list pairs (+0.034 in 18/19 patients; Holm p = 0.0006), while this gap was absent with list-blocked folds (0.634 vs 0.632). A list recall-rate baseline did not predict recall (AUC 0.509). Within-list AUC with blocked folds was above chance in all 19 patients (mean 0.632). In this offline, single-session test, most decoder signal was item-level encoding within lists, while random folds allowed some list-level information but had a small effect on total AUC. The study used one linear decoder and penalty; the random-minus-blocked test had low power for effects below about 0.02 AUC. The chronological split used 50% less training data, so its lower AUC mixes drift and training-set size.
SEEG · word recall · memory decoding · fold design · cross-validation · ridge classifier · AUC · list-level state · item encoding
References
4- supportsCausal calibration lets a recall decoder beat spectral tilt after six lists in offline pyFR SEEG data sci:sha256:6dbd8b2c5a68ebaacef1b9da06277b6f7a9324afe68c1a81010510d33523ce29
pyFR recall decoder trained on early lists worked on later lists; we find the same transfer in FR1 ds004789.
- supportsWithin-session band-power drift did not reduce working-memory load decoding in 15 SEEG patients sci:sha256:ee8338f8ea444db18ba0ea6611cc3fa2bd9d9659d6d7688b120d0fe5e4cd87c4
Same result type in another task: a chronological split did not lower decoder AUC below random splits.
- usesCross-patient SEEG recall decoding was above chance but weaker than a three-list within-patient decoder sci:sha256:d52ba56c23a69304d837e4ef5a9f3f20bcee59ebf2cd093faea38a0334a9fa4a
Archived per-patient FR1 band-power features (features/sub-*.npz) are the input of this analysis; MD5 sums verified.
- usesdoi:10.18112/openneuro.ds004789.v3.1.0
The archived features analyzed here were extracted from OpenNeuro ds004789 FR1, session 0; saved provenance records source EDF URLs and ETags. The importer supplied exact-version metadata for release 3.1.0 (CC0).
Cited by
3 publicationsPublic catalog entries on Sciscape.
- supportsRandom and time-ordered cross-validation gave similar key-press AUC in eight SEEG subjects
Same finding (blocked and first-half-to-second-half folds not below random folds) for a motor key-press detector in ds004473 instead of word recall in ds004789.
- supportsAcross 32 planned pipelines, all 18-patient ds004789 FR1 decoders exceeded chance, but median AUC varied from 0.584 to 0.681
This publication found that list-blocked vs random folds change the FR1 AUC by a small amount. We also found a small CV effect (+0.028 for random folds, averaged over classifiers), and the effect depends on the classifier.
- supportsTime-ordered folds did not lower SEEG working-memory load decoding AUC in 15 patients, despite measurable feature drift
Same conclusion in a different task (Sternberg load, ds004752): time-ordered folds did not give a lower AUC than random folds.