Active Ordering of Interactive Prediction Tasks

Many applications involve a set of prediction tasks that must be accomplished sequentially through user interaction. If the tasks are interdependent, the order in which they are posed may have a significant impact on the effective utilization of user feedback by the prediction systems, affecting their overall performance. This paper presents a novel approach for dynamically ordering a series of prediction tasks by taking into account the effect of user feedback on the performance of multiple prediction systems. The proposed approach represents a general strategy for learning incrementally during test phase when the system interacts with the end-user, who expects good performance instead of merely providing correct labels to the system. Therefore, the system must balance system benefit against user benefit when selecting items for user's attention. We apply the proposed approach to two practical applications that involve interactive trouble report generation and document annotatio...

• Type: Conference
• Year: 2010
• Where: SDM
• Authors: Abhimanyu Lad, Yiming Yang
• Keywords: Data Mining, Prediction, Prediction Systems, Prediction Tasks, SDM 2010