Tuning
Tuning: Hyperparameters: Settings You Choose, Searching for Good Settings.
Updated
- Hyperparameters: Settings You Choose (Journeyman): A hyperparameter is a setting you choose before fit, such as a tree's max_depth, while fit learns the rest, such as the tree's questions; get_params and set_params read and change the settings, the defaults are only a starting point, and settings are chosen with cross-validation on the training rows, never with the test set.
- Searching for Good Settings (Freelancer): GridSearchCV tries every combination of the settings you list, scores each by cross-validation on the training rows, keeps the best in best_params_ and best_score_ with every result in cv_results_, and refits the best pipeline on all the training rows, ready for one final test score; a pipeline's settings are named step__setting, and RandomizedSearchCV tries a sample when the grid is too big.