Discriminant Ranking for Efficient Treebanking

Treebank annotation is a labor-intensive and time-consuming task. In this paper, we show that a simple statistical ranking model can significantly improve treebanking efficiency by prompting human annotators, well-trained in disambiguation tasks for treebanking but not necessarily grammar experts, to the most relevant linguistic disambiguation decisions. Experiments were carried out to evaluate the impact of such techniques on annotation efficiency and quality. The detailed analysis of outputs from the ranking model shows strong correlation to the human annotator behavior. When integrated into the treebanking environment, the model brings a significant annotation speed-up with improved inter-annotator agreement.

• Type: Journal
• Year: 2010
• Where: COLING
• Authors: Yi Zhang 0003, Valia Kordoni
• Keywords: Annotation, COLING 2010, Computational Linguistics, Human Annotator, Ranking Model