Rank learning for factoid question answering with linguistic and semantic constraints

This work presents a general rank-learning framework for passage ranking within Question Answering (QA) systems using linguistic and semantic features. The framework enables query-time checking of complex linguistic and semantic constraints over keywords. Constraints are composed of a mixture of keyword and named entity features, as well as features derived from semantic role labeling. The framework supports the checking of constraints of arbitrary length relating any number of keywords. We show that a trained ranking model using this rich feature set achieves greater than a 20% improvement in Mean Average Precision over baseline keyword retrieval models. We also show that constraints based on semantic role labeling features are particularly effective for passage retrieval; when they can be leveraged, an 40% improvement in MAP over the baseline can be realized. Categories and Subject Descriptors H.3.3 [Information Storage and Retrieval]: Information Search and Retrieval General Terms...

• Type: Journal
• Year: 2010
• Where: CIKM
• Authors: Matthew W. Bilotti, Jonathan L. Elsas, Jaime G. Carbonell, Eric Nyberg
• Keywords: CIKM 2010, Information Technology, Question Answering, Semantic, Semantic Role