Cost-Sensitive Boosting

—A novel framework is proposed for the design of cost-sensitive boosting algorithms. The framework is based on the identification of two necessary conditions for optimal cost-sensitive learning that 1) expected losses must be minimized by optimal cost-sensitive decision rules and 2) empirical loss minimization must emphasize the neighborhood of the target cost-sensitive boundary. It is shown that these conditions enable the derivation of cost-sensitive losses that can be minimized by gradient descent, in the functional space of convex combinations of weak learners, to produce novel boosting algorithms. The proposed framework is applied to the derivation of cost-sensitive extensions of AdaBoost, RealBoost, and LogitBoost. Experimental evidence, with a synthetic problem, standard data sets, and the computer vision problems of face and car detection, is presented in support of the cost-sensitive optimality of the new algorithms. Their performance is also compared to those of various pre...

• Type: Journal
• Year: 2011
• Where: PAMI
• Authors: Hamed Masnadi-Shirazi, Nuno Vasconcelos
• Keywords: Cost-sensitive Boosting, Cost-sensitive Boosting Algorithms, Operations Research, Optimal Cost-sensitive Decision, PAMI 2011