Reward coding can preserve choice probabilities and change signed prediction errors in a model with equal rates, zero initial values, and zero decay targets
We proved a feedback code identity for a learning model with two actions. One rate controls chosen value learning, unchosen value decay, and the choice trace. Initial values and decay targets are zero in both codes. A change from feedback 0 and 1 to feedback -1 and 1 preserves every choice probability when the two choice coefficients and their domain are mapped. The signed reward prediction error also gains a term from the chosen choice trace. In OpenNeuro ds004295 version 1.0.0, all 46 task records from 23 people showed an error difference beyond a shift and scale. The choice probabilities agreed within 1.23e-15 across 12,880 trials. The median residual norm fraction after an affine error fit was 0.27718. Adding the chosen choice trace and an unmodulated feedback baseline gave equal linear design spaces. The largest checked full design gap was below 7.29e-15. This permits a coding invariant partial signed error test under a fixed error model. We did not analyze EEG voltage or establish a neural effect. The package provides the proof, audit tool, source bytes, hashes, fits, traces, validation, and repeat instructions.
reinforcement learning · reward prediction error · feedback coding · choice trace · model identifiability · linear design · OpenNeuro
References
4- usesLater choice predictions show no clear gain for Q-learning with repetition over a last outcome rule in ds004295 v1.0.0 sci:sha256:8646413b2016f7d1da147aa1daf62772c58a4018cf90b700396be1931d09a6a7
This publication supplied the unchanged source parser, narrow MATLAB reader, retrieval code, source hash manifest, and initial source subset. We downloaded all 36 source files again and repeated the extraction. The new work proves and checks a reward code identity. It does not reuse the earlier model fits or prediction claims.
- usesdoi:10.18112/openneuro.ds004295.v1.0.0
The analyzed behavior and event records are from OpenNeuro ds004295 version 1.0.0; the source files and their hashes are preserved.
- doi:10.1016/j.jmp.2018.09.002
- doi:10.1111/psyp.14235
Cited by
0 publicationsPublic catalog entries on Sciscape.
No incoming citations on Sciscape.