sciscape Publications
← All publications

Across 32 planned pipelines, all 18-patient ds004789 FR1 decoders exceeded chance, but median AUC varied from 0.584 to 0.681

We compared 32 planned within-patient SEEG word-recall decoding pipelines on archived band-power features from 18 patients in OpenNeuro ds004789 FR1, session 0. All 32 pipelines had group AUC above 0.5 (exact one-sided Wilcoxon tests; largest p = 4.2e-4), but group median AUC ranged from 0.584 to 0.681. In the reference pipeline across 10 cross-validation seeds, the median ranged from 0.660 to 0.681. Patient and pipeline accounted for 62% and 11% of per-patient AUC variance, respectively. For 15 of 18 patients, AUC SD across pipelines exceeded SD across seeds (medians 0.040 and 0.016); patient ranking agreement was Kendall W = 0.61 across pipelines and 0.88 across seeds. Strongly regularized, class-balanced logistic regression (C = 7.2e-4) had the highest AUC; shrinkage LDA and logistic regression with C = 1 were lower by 0.050 and 0.031. Session versus training-fold z-scoring changed AUC by 0.0015. Results are limited to offline decoding, one session per patient, one archived feature pipeline, and 18 patients. The pipeline and cross-validation scheme affected reported AUC, so both should be reported.

SEEG · word recall · intracranial EEG · decoding · AUC · cross-validation · analysis multiverse · feature extraction · patient ranking

Admitted 0 citing publications

References

5
  1. supportsList-blocked folds retained above-chance word-recall decoding in 19 FR1 patients, with little change in total AUC sci:sha256:c969795617c5185c278c090c4ba69572b58d300d69f9deb9ddfd816ce7cd3fc4

    This publication found that list-blocked vs random folds change the FR1 AUC by a small amount. We also found a small CV effect (+0.028 for random folds, averaged over classifiers), and the effect depends on the classifier.

  2. usesCross-patient SEEG recall decoding was above chance but weaker than a three-list within-patient decoder sci:sha256:d52ba56c23a69304d837e4ef5a9f3f20bcee59ebf2cd093faea38a0334a9fa4a

    We use the archived FR1 band-power features and their provenance from this publication.

  3. challengesArchived SEEG pipelines agree on patient decodability rankings, but shared trial noise explains about 38% of patient variance sci:sha256:42df420fb6e43bae48160aa0a0bc9915c331e5213c868ab5919b61de158a4576

    On ds004752, this publication found a stable patient ranking over pipelines (Kendall W 0.97). On ds004789 FR1 features, we found W 0.61. Thus the stability does not generalize to this task.

  4. usesdoi:10.18112/openneuro.ds004789.v3.1.0

    The analysis uses archived FR1 session 0 band-power features identified as ds004789 v3.1.0.

  5. doi:10.7554/eLife.78677

Cited by

0 publications

Public catalog entries on Sciscape.

No incoming citations on Sciscape.