On Multi-Class Cost-Sensitive Learning

Rescaling is possibly the most popular approach to cost-sensitive learning. This approach works by rescaling the classes according to their costs, and it can be realized in different ways, e.g., weighting or sampling the training examples in proportion to their costs, moving the decision boundary of classifiers faraway from high-cost classes in proportion to costs, etc. This approach is very effective in dealing with two-class problems, yet some studies showed that it is often not so helpful on multi-class problems. In this paper, we try to explore why the rescaling approach is often helpless on multi-class problems. Our analysis discloses that the rescaling approach works well when the costs are consistent, while directly applying it to multi-class problems with inconsistent costs may not be a good choice. Based on this recognition, we advocate that before applying the rescaling approach, the consistency of the costs should be examined at first. If the costs are consistent, the resca...

• Type: Conference
• Year: 2006
• Where: AAAI
• Authors: Zhi-Hua Zhou, Xu-Ying Liu
• Keywords: AAAI 2006, Approach Works, Cost-sensitive Learning, Intelligent Agents, Multi-class Problems