With final blocks held out, tied targets allow either top-10 order of two count rules in MovieLens 100K and 1M
Movie rating logs can assign the same final timestamp to several ratings from one user. We tested how this ambiguity changes a fixed-model benchmark in MovieLens 100K and 1M. We excluded each user's full final timestamp block from training. We fit three score rules once and calculated exact top-10 hit-rate bounds over all choices of one final target per user. Equal model scores received their expected credit under uniform score order. Final timestamps were tied for 415 of 943 users in 100K and 2,544 of 6,040 users in 1M. In an exploratory comparison, the paired difference between all-rating count and positive-rating count ranged from -0.954 to +5.355 percentage points in 100K and from -0.902 to +1.358 points in 1M. Each range allows either model order. In 1M, selecting the first rather than last source row among tied targets reversed that order. In the primary model comparison, all-rating count exceeded a shrunk movie mean for every target choice in 1M, with a minimum lead of 0.116 points. The package gives the finite-data method, code, aggregate tables, figures, source hashes, and independent calculation checks. These bounds keep training fixed. They do not cover ordinary leave-one-out retraining, future deployment, or movie viewing order.
MovieLens · timestamp ties · recommender evaluation · partial identification · rating behavior · reproducibility
References
5- usesdoi:10.1145/2827872
We analyze the MovieLens 100K and 1M source releases and follow the provider attribution request.
- supportsdoi:10.48550/arXiv.2010.11060
Prior work explains temporal leakage in recommender tests. Our pooled user-prefix training is not a prospective deployment test.
- usesdoi:10.48550/arXiv.2609.26977
Prior work treats expected hit credit under uniform order of equal model scores. We fix this treatment while varying the final target.
- doi:10.48550/arXiv.2602.19339
SplitLight is prior work on dataset and split diagnostics. We make a narrower calculation of target-choice and paired model bounds.
- doi:10.48550/arXiv.2307.09985
Prior MovieLens analysis describes collection effects and the difference between rating entry and movie consumption.
Cited by
1 publicationPublic catalog entries on Sciscape.
- Pairs at equal times carry most rating match excess in MovieLens 100K and 1M under uniform tie weights and a user shuffle reference
Related finite-data limits for final target choice with fixed recommendation models. Our tool instead couples endpoints across all time groups to bound star-rating matches.