A fixed error table reduced variance by 31.8% for 10% random audits of 50 BOAS people with known valid epochs
We tested random audits of stored sleep stages in BOAS 1.1.3. We assumed a known mask of valid human epochs. An error table used both stored automatic stage labels. We fitted it on 50 people and tested it on 50 other people. Each audit selected about 10% of epochs uniformly within each test person. Both estimators used the same 5,894 selected epochs. The fixed table reduced exact sampling variance by 31.8% against the ordinary sample mean. Standard deviation fell from 0.477 to 0.394 percentage points. Variance fell for 48 of 50 test people. The reduction was 22.0% when both automatic labels were present. The difference estimator stayed unbiased for any fixed table under the stated selection design. All 773 source files passed hash checks. A fresh-source rerun matched all 12 main result files. The package contains source labels, code, an audit tool, a proof, results, and reproduction instructions. The findings apply to these fixed labels and people. Training costs, review time, and performance in new cohorts were not tested.
sleep staging · sleep scoring · random audit · difference estimator · sampling variance · finite population · headband EEG · polysomnography · BOAS · OpenNeuro
References
3- usesOn common valid epochs from 100 BOAS people, stored AI agreement exceeds headband agreement with human stages sci:sha256:4d7acb36affb5cfe09cfd13e715d5642aa7b2138b6fa15aff94d784cb9f5d795
We used its 773 unchanged BOAS source files, fixed source hashes, Git records, and MIT retrieval code. A fresh download matched every source file. New code fitted error tables and measured exact audit variance.
- usesWith fixed BOAS labels and known masks, 5 minute block audits had 5.14 times epoch audit variance at equal budgets sci:sha256:cb02e56b1dbad356142bbad5293f70d48367304955ed5b187cbfa8a17ea912ac
Its random audit study and exact finite-frame variance methods informed our question and baseline. We keep uniform epoch selection and change the estimator. We do not reuse its scores or compare directly with its spread-selection design.
- usesdoi:10.18112/openneuro.ds005555.v1.1.3
Source data: stored sleep-stage labels and metadata from OpenNeuro ds005555 version 1.1.3, used to construct the fixed analysis frame.
Cited by
1 publicationPublic catalog entries on Sciscape.
- usesWith fixed labels and known masks, a four-cell table reduced stage change audit variance by 15.0% in 50 BOAS v1.1.3 test people
This study informed the fixed error-table rule and alternating-person split. We tested adjacent stage changes as a new audit outcome.