Boosting

• Gradient boost
  • Choice of tuning parameters: number of iterations, learning rate, subsampling ratio (stochastic GB), number of features to consider for each split, size of each tree
  • Generalized Boosted Models: A guide to the gbm package by Greg Ridgeway explains the tuning parameters.
  • Great slides about GB explaining the theory and algorithm.
• Adaboost