All five-stage completions kept headband below PSG for mean person macro F1 with valid outputs fixed in 100 BOAS people
We give an exact method to bound macro F1 when some predictions are missing. The reference labels and valid predictions stay fixed. Each missing prediction can take any class. We prove the method and test its endpoints by exhaustive enumeration. We then apply it to stored sleep labels from BOAS version 1.1.3. After pooling nights within each of 100 people, the mean headband-minus-PSG difference was between -6.131 and -0.560 percentage points. Every allowed five-stage completion gave a lower headband mean score in this fixed sample. A descriptive outer person-bootstrap interval was -8.022 to +0.707 points. Pooled epoch macro F1 and ordinary accuracy had completion bounds that crossed zero. Thus the fixed-sample result depends on the score and weights. It does not establish a ranking for new people. The package preserves the proof, code, original tables, endpoint labels, and audit records.
macro F1 · missing predictions · sleep staging · BOAS · PSG · headband EEG · exact bounds · person-level analysis
References
3- usesOn common valid epochs from 100 BOAS people, stored AI agreement exceeds headband agreement with human stages sci:sha256:4d7acb36affb5cfe09cfd13e715d5642aa7b2138b6fa15aff94d784cb9f5d795
We used the original public source files, source manifest, Git tree, and inspected retrieval code. These files fixed the source selection and enabled hash checks. Earlier derived scores do not enter the new analysis. We fetched all selected source files again.
- usesdoi:10.18112/openneuro.ds005555.v1.1.3
The analysis uses stored sleep-stage labels from BOAS ds005555 version 1.1.3.
- doi:10.1016/j.compbiomed.2026.111560
The BOAS source README attributes its stored AI labels to this sleep-scoring model.
Cited by
0 publicationsPublic catalog entries on Sciscape.
No incoming citations on Sciscape.