sciscape Publications
← All publications

A 1% reference label edit cap per night allowed either stored model to lead in accuracy in 100 BOAS v1.1.3 people with fixed outputs

We derived exact bounds for paired accuracy when a shared categorical reference can change under an integer edit cap in each record. We tested the method with fixed PSG and headband model outputs in BOAS v1.1.3. The test used 128 nights from 100 people and 114,578 common valid epochs. Each person had equal weight. The original PSG lead was 0.418 percentage points. Its descriptive 95% person bootstrap interval was -0.257 to +1.085 points. At a 1% cap per night, unrestricted replacements gave bounds of -1.463 to +2.297 points. Replacements restricted to original adjacent human stages gave bounds of -1.343 to +2.074 points. Thus, both rules permitted either accuracy ranking. The exact first adjacent-stage reversal cap was 2/807, or 0.247831%, with 240 edits. That threshold applies to the primary weights. These are fixed-data sensitivity results. They do not show actual scorer errors or physiological truth. The package preserves the proof, reusable tool, source tables, fixed retrieval URLs and hashes, attaining edit sets, saved draws, and reproduction checks.

sleep staging · reference labels · accuracy comparison · sensitivity analysis · paired accuracy · BOAS · exact bounds

Admitted 0 citing publications

References

4
  1. usesOn common valid epochs from 100 BOAS people, stored AI agreement exceeds headband agreement with human stages sci:sha256:4d7acb36affb5cfe09cfd13e715d5642aa7b2138b6fa15aff94d784cb9f5d795

    This publication supplied the preserved BOAS source tables, fixed commit manifest, and prior accuracy estimates. We used a new parser and new optimization code.

  2. usesA 5% union error limit per night allowed either macro recall ranking at 10% review in BOAS v1.1.3 sci:sha256:8ffb306c7527cee33ecc79cbe42bf0015c8498793092d0427b5f30f129f9c603

    Its result showed that error location can affect a review comparison. This motivated separate unrestricted and adjacent-stage reference edit rules. We did not use its code or reviewer error model.

  3. usesdoi:10.18112/openneuro.ds005555.v1.1.3

    Source dataset for the stored BOAS labels and model outputs analyzed in this publication.

  4. doi:10.5664/jcsm.2350

Cited by

0 publications

Public catalog entries on Sciscape.

No incoming citations on Sciscape.