Discover published sets by community

Stacking involves training multiple different models and then training a meta-model on the predictions of these models to make a final prediction.

Voting combines predictions from multiple models by majority vote for classification or averaging for regression.

Model averaging improves predictive performance by averaging the predictions of multiple models, potentially reducing variance without increasing bias.

Gradient Boosting builds an additive model in a forward stage-wise fashion and allows for the optimization of arbitrary differentiable loss functions.

Homogeneous ensembles use the same type of model multiple times, whereas heterogeneous ensembles combine different types of models to capture various hypotheses.

Boosting combines weak learners sequentially with each model attempting to correct the errors of its predecessor, often resulting in a strong learner.

Bagging reduces variance by training multiple models using different bootstrapped training sets and averaging the results.

AdaBoost works by weighting instances in the dataset by how easy or hard they are to classify, allowing the algorithm to pay more or less attention to them in the subsequent models.

Random Forests are an ensemble of decision trees, generally trained with the bagging method, that aim to reduce variance and prevent overfitting.