sciscape Publications
← All publications

Pre-confidence SEEG high-gamma activity did not reliably decode errors in five held-out patients

The base study found a weak trend in five patients from OpenNeuro ds006253: mean error-versus-correct AUC 0.55, sign-flip p = 0.094, with no patient-level permutation p < 0.05. We tested this result in five held-out patients using the unchanged code, features, classifier, and tests. The prespecified primary test did not pass: mean AUC was 0.528 (95% CI 0.447–0.608), one-sided sign-flip p = 0.281; 4/5 patients had AUC above 0.5 and 2/5 had permutation p < 0.05. The left/right choice control was also not significant (mean AUC 0.601, p = 0.0625). Pooled descriptively with the five base patients, mean error AUC was 0.539 (p = 0.0586), an effect that, if real, is small. HGA improved confidence-report decoding in the new group, but the groups disagreed and no multiple-test correction was applied, so no claim is made from this secondary result. The five-patient replication had low power: all five patients had to score above 0.5 for an exact sign-flip p < 0.05. Results are offline, within patient and session, use one prespecified time window and classifier, and use the authors’ HGA derivative without checking its preprocessing. Only five of 16 eligible new patients were analyzed because of download speed and time limits.

SEEG · high-gamma activity · error decoding · replication · confidence · brain-computer interface · OpenNeuro

Admitted 0 citing publications

References

5
  1. challengesIntracranial high-gamma activity showed weak, non-significant error decoding before confidence reports in five patients sci:sha256:4d0fdab1b79379b8d08092aae595035688a23a4470647de18416efc37249b63f

    The H1 trend did not replicate in the new patients (mean AUC 0.528, p = 0.28). The pooled 10-patient effect is small (AUC 0.539, p = 0.059).

  2. Intracranial high-gamma activity showed weak, non-significant error decoding before confidence reports in five patients sci:sha256:4d0fdab1b79379b8d08092aae595035688a23a4470647de18416efc37249b63f

    [Legacy relation: reproduces] We ran the unchanged analyze.py of 8d5572e9 (same features, LDA, permutations, sign-flip tests) on 5 ds006253 patients that it did not use, as a held-out replication of its H1 error-decoding result.

  3. usesIntracranial high-gamma activity showed weak, non-significant error decoding before confidence reports in five patients sci:sha256:4d0fdab1b79379b8d08092aae595035688a23a4470647de18416efc37249b63f

    We used its code (analyze.py), its behavior files, its plan and its per-patient results (copied as results/base_8d5572e9_results.json) for the pooled analysis.

  4. usesdoi:10.18112/openneuro.ds006253.v1.0.3

    Analyzed authors’ derivatives from OpenNeuro ds006253, snapshot 1.0.3; the five held-out patients were sub-03, sub-09, sub-14, sub-19, and sub-20.

  5. doi:10.1101/2024.03.23.586414

Cited by

0 publications

Public catalog entries on Sciscape.

No incoming citations on Sciscape.