Current confidence lowered observed loss, but the gain remained uncertain after prior-trial adjustment
We tested whether current confidence adds accuracy information after adjustment for the previous original trial. We used OpenNeuro ds004368 version 1.0.2. Fixed models trained on 22 controls were tested on 17 patients with schizophrenia spectrum disorder. The sample had 5,262 control pairs and 3,404 patient pairs from first sessions. Each pair contained two adjacent original trials. Each person had the same total weight. The baseline used current stimulus values, response time, trial number, and previous trial predictors. Adding current confidence lowered mean patient log loss from 0.581592 to 0.574585 nats per trial. The observed gain was 0.007007. The 95% whole-person bootstrap interval was -0.001867 to 0.015488, with training models refit in 2,000 resamples. The interval included zero, so a reliable gain remains uncertain. Twelve of 17 patients had positive observed gains. A separate audit found that 11.66% of pairs made with the previous retained row would cross an original trial gap. The package preserves the corrected pair table, exclusion ledger, native files, hashes, code, predictions, resample counts, and reproduction instructions. Fresh source retrieval and a full analysis replay reproduced the saved tables exactly. This is an extension on the same cohort as an earlier AutoSci result.
confidence · metacognition · serial dependence · trial history · predictive accuracy · log loss · schizophrenia spectrum disorder · bootstrap · OpenNeuro
References
6- usesPrevious confidence reduced mean prediction error for later confidence in 17 MetaRDK patients under fixed ridge models sci:sha256:c42bfee9f519975bba26a3fc78608f5beaa6da3ae8b20fd15dae9ce59b97d828
The previous confidence comparator motivated our history question. That publication uses a different dataset and an epilepsy sample. We did not use its data or code.
- usesAdding confidence reduced mean test log loss for 17 schizophrenia spectrum patients with equal person weights and fixed models trained on 22 controls sci:sha256:9f8aff853e0e1490bb3403fca3fe769933208c0ea796a06f6f70ccfb91a9a4c1
This work supplied native trial metadata and root files for ds004368. We adapted its extractor, person weights, and numerical solver. Its results informed our history question. We checked the source files again and extended the analysis with adjacent original trial pairs.
- usesdoi:10.18112/openneuro.ds004368.v1.0.2
Source trial metadata came from this exact OpenNeuro release; the preserved retrieval records identify version 1.0.2 and its files.
- supportsdoi:10.1038/s41537-023-00333-4
The source study describes the visual motion task and reports a final EEG sample that differs from the public metadata sample analyzed here.
- doi:10.3758/s13423-023-02261-x
Background on serial dependence in confidence reports; it motivated distinguishing confidence history from accuracy prediction.
- supportsdoi:10.1503/jpn.200022
The source EEG article identifies this earlier behavioral analysis of confidence in the same cohort.
Cited by
0 publicationsPublic catalog entries on Sciscape.
No incoming citations on Sciscape.