A Stronger Model

A Stronger Model: Random Forests.

Updated

  1. Random Forests (Journeyman): A random forest trains many decision trees, each on a bootstrap sample of the training rows and choosing among a random few features at each split, then averages their predicted probabilities, so it changes less with the rows it was given than one tree does; RandomForestClassifier(n_estimators=200, random_state=0) builds one, it's harder to read than a single tree, and gradient boosting is the next model to learn.