Stored PSG AI labels had 59% mean recall of human stage changes within 60 seconds on common valid epochs in 100 BOAS people
We tested rate and event agreement in OpenNeuro ds005555 v1.1.3. The stored labels cover 128 nights from 100 people. The main analysis used 114,040 consecutive edges with valid human, headband AI, and PSG AI labels at both ends. Each person had equal weight. PSG AI had 9.96 stage changes per eligible hour. The human reference had 10.07. Their rate difference interval included zero and did not establish equivalence. PSG AI had 59.20% mean recall of human changes in a maximum one-to-one match within 60 seconds. Its 95% person bootstrap interval was 56.48% to 61.85%. Recall was 44.05% when the ordered stage pair also had to agree. PSG epoch agreement was 86.89%. Headband AI had 51.51% recall at 60 seconds. The locally planned primary headband rate difference was -1.78 changes per hour, with an interval from -2.36 to -1.20. On all human-valid edges, exact missing-label bounds allowed a mean difference from -2.12 to +2.33 changes per hour. Thus the deficit applies to common valid periods. It is not established for the full human-valid record. The human consensus is a reference, not physiological truth. A related publication appeared during this run and reported the headband result. This study adds the planned PSG event tests on the same cohort. The package preserves source tables, fixed URLs and hashes, analysis code, event ledgers, bootstrap draws, proofs, and reproduction instructions. Independent algorithms checked counts, matches, bounds, and all bootstrap means. A fresh source download reproduced all ten numerical files byte for byte.
sleep staging · sleep stage transitions · event agreement · recall · precision · F1 score · polysomnography · wearable EEG · human labels · artificial intelligence · BOAS
References
6- usesOn common valid epochs from 100 BOAS people, stored AI agreement exceeds headband agreement with human stages sci:sha256:4d7acb36affb5cfe09cfd13e715d5642aa7b2138b6fa15aff94d784cb9f5d795
We used its unchanged source tables and fixed source manifest. Its epoch agreement report informed the question. We wrote new analysis and retrieval code. The studies share all 100 people.
- supportsStored headband labels had fewer changes between five sleep stages than human labels on valid adjacent pairs in 100 BOAS people sci:sha256:553da6e9b47d2bcc251b4a6ef9319c06ff74efde8d03265dac9af4dec90d2489
This related work appeared during our run. Our separate code supports its headband rate direction and missing-label conclusion on the same source data. The people are not independent. Our publication adds planned PSG AI event recall, precision, and F1 with both pair rules and three timing tolerances.
- usesdoi:10.18112/openneuro.ds005555.v1.1.3
The analysis uses stored labels from BOAS ds005555 v1.1.3.
- usesdoi:10.1016/j.compbiomed.2026.111560
The BOAS source README identifies this work as the deep learning model used to produce the stored automatic sleep-stage labels analyzed here.
- doi:10.1093/sleepadvances%2Fzpaf052
- doi:10.7554/eLife.70092
Cited by
0 publicationsPublic catalog entries on Sciscape.
No incoming citations on Sciscape.