The Most Robust Loss Function for Boosting

Boosting algorithm is understood as the gradient descent algorithm of a loss function. It is often pointed out that the typical boosting algorithm, Adaboost, is seriously affected by the outliers. In this paper, loss functions for robust boosting are studied. Based on a concept of the robust statistics, we propose a positive-part-truncation of the loss function which makes the boosting algorithm robust against extreme outliers. Numerical experiments show that the proposed boosting algorithm is useful for highly noisy data in comparison with other competitors.

• Type: Conference
• Year: 2004
• Where: ICONIP
• Authors: Takafumi Kanamori, Takashi Takenouchi, Shinto Eguchi, Noboru Murata
• Keywords: Boosting Algorithm, ICONIP 2004, ICONIP 2007, Loss Function, Typical Boosting Algorithm