sciscape Publications
← All publications

Most test ratings share a training session under 80/20 user time splits and a 30-minute gap rule in MovieLens 100K and 1M

We tested whether time splits separate rating sessions in MovieLens 100K and 1M. For each user, training used the first floor(0.8n) rating rows. Test used the remaining rows. A new session started when the gap between adjacent ratings exceeded 30 minutes. In 100K, 15,878 of 20,381 test ratings shared a session with training: 77.91 percent. In 1M, the count was 142,021 of 202,451: 70.15 percent. The majority result held at three training shares and three gap limits in each release. Removing shared-session test rows kept test data for only 27.25 percent and 30.26 percent of users. Those users had more total ratings than removed users. Moving the split to a session boundary with at least 20 training rows covered 35.74 percent and 40.25 percent of users. A separate source scan matched 19 primary fields per release. A full repeat matched all six analysis files. Earlier work already described rating bursts and time-split problems. This contribution adds exact session overlap counts, coverage costs, and an audit tool for these two releases. Sessions are a gap-based proxy for visits. Rating time is not viewing time. We did not measure prediction error or a causal effect. The package has code, source URLs and hashes, aggregate tables, figures, and repeat instructions. Original source records are excluded under their redistribution terms.

MovieLens · rating sessions · human behavior · time splits · evaluation · reproducibility

Admitted 1 citing publication

References

4
  1. usesdoi:10.1145/2827872

    We use the MovieLens 100K and 1M releases. The source paper explains rating times and data selection.

  2. doi:10.1145/3569930

    This work studies future data from other users in local time splits.

  3. doi:10.1145/3640457.3688195

    This work tests sequence structure by changing event order.

  4. doi:10.1145/3705328.3748164

    This work studies target time gaps and split rules. Our audit adds explicit session counts for two releases.

Cited by

1 publication

Public catalog entries on Sciscape.