Anytime Induction of Cost-sensitive Trees

Machine learning techniques are increasingly being used to produce a wide-range of classifiers for complex real-world applications that involve nonuniform testing costs and misclassification costs. As the complexity of these applications grows, the management of resources during the learning and classification processes becomes a challenging task. In this work we introduce ACT (Anytime Cost-sensitive Trees), a novel framework for operating in such environments. ACT is an anytime algorithm that allows trading computation time for lower classification costs. It builds a tree top-down and exploits additional time resources to obtain better estimations for the utility of the different candidate splits. Using sampling techniques ACT approximates for each candidate split the cost of the subtree under it and favors the one with a minimal cost. Due to its stochastic nature ACT is expected to be able to escape local minima, into which greedy methods may be trapped. Experiments with a varie...

• Type: Conference
• Year: 2007
• Where: NIPS
• Authors: Saher Esmeir, Shaul Markovitch
• Keywords: Cost-sensitive Tree, Information Technology, NIPS 2007, Nonuniform Testing Costs, Techniques Act Approximates