Distribution drift¶
Generated by pippen drift. Compares the earliest shipped rating window against the latest, 2018 against 2024.
These ratings are recomputed from scratch rather than predicted, so this is not model drift against production traffic. It answers a narrower question: has the league's impact distribution moved enough that comparing a player across these windows needs a caveat?
| Column | PSI | Reading | KS | p | Reference n | Comparison n |
|---|---|---|---|---|---|---|
offensive |
0.034 | stable | 0.049 | 0.301 | 743 | 773 |
defensive |
0.069 | stable | 0.071 | 0.0399 | 743 | 773 |
total |
0.045 | stable | 0.054 | 0.206 | 743 | 773 |
PSI bands are the credit-scoring convention: below 0.1 the same population, 0.1 to 0.25 worth watching, above 0.25 a different population.
A large KS statistic with a small p-value on a sample this size is easy to obtain and hard to interpret. Read the PSI first.