Improved Extraction Assessment through Better Language Models

A variety of information extraction techniques rely on the fact that instances of the same relation are "distributionally similar," in that they tend to appear in similar textual contexts. We demonstrate that extraction accuracy depends heavily on the accuracy of the language model utilized to estimate distributional similarity. An unsupervised model selection technique based on this observation is shown to reduce extraction and type-checking error by 26% over previous results, in experiments with Hidden Markov Models. The results suggest that optimizing statistical language models over unlabeled data is a promising direction for improving weakly supervised and unsupervised information extraction.

• Type: Journal
• Year: 2010
• Where: NAACL
• Authors: Arun Ahuja, Doug Downey
• Keywords: Computational Linguistics, Information Extraction, Language Models, NAACL 2010, Similar Textual Contexts