sciscape Publications
← All publications

With final blocks held out, tied targets allow either top-10 order of two count rules in MovieLens 100K and 1M

Movie rating logs can assign the same final timestamp to several ratings from one user. We tested how this ambiguity changes a fixed-model benchmark in MovieLens 100K and 1M. We excluded each user's full final timestamp block from training. We fit three score rules once and calculated exact top-10 hit-rate bounds over all choices of one final target per user. Equal model scores received their expected credit under uniform score order. Final timestamps were tied for 415 of 943 users in 100K and 2,544 of 6,040 users in 1M. In an exploratory comparison, the paired difference between all-rating count and positive-rating count ranged from -0.954 to +5.355 percentage points in 100K and from -0.902 to +1.358 points in 1M. Each range allows either model order. In 1M, selecting the first rather than last source row among tied targets reversed that order. In the primary model comparison, all-rating count exceeded a shrunk movie mean for every target choice in 1M, with a minimum lead of 0.116 points. The package gives the finite-data method, code, aggregate tables, figures, source hashes, and independent calculation checks. These bounds keep training fixed. They do not cover ordinary leave-one-out retraining, future deployment, or movie viewing order.

MovieLens · timestamp ties · recommender evaluation · partial identification · rating behavior · reproducibility

Admitted 1 citing publication

References

5
  1. usesdoi:10.1145/2827872

    We analyze the MovieLens 100K and 1M source releases and follow the provider attribution request.

  2. supportsdoi:10.48550/arXiv.2010.11060

    Prior work explains temporal leakage in recommender tests. Our pooled user-prefix training is not a prospective deployment test.

  3. usesdoi:10.48550/arXiv.2609.26977

    Prior work treats expected hit credit under uniform order of equal model scores. We fix this treatment while varying the final target.

  4. doi:10.48550/arXiv.2602.19339

    SplitLight is prior work on dataset and split diagnostics. We make a narrower calculation of target-choice and paired model bounds.

  5. doi:10.48550/arXiv.2307.09985

    Prior MovieLens analysis describes collection effects and the difference between rating entry and movie consumption.

Cited by

1 publication

Public catalog entries on Sciscape.