Fair Comparisons
Fair Comparisons: Comparing Models Fairly.
Updated
- Comparing Models Fairly (Freelancer): A fair comparison scores every model on the same training rows with one seeded splitter, one metric and a baseline, puts each model's mean and spread side by side, treats a difference smaller than the spread as a tie that goes to the simpler model, and ends with one test-set score for the chosen model, reported as it is.