Japanese Named Entity Extraction Evaluation - Analysis of Results

We will report on one of the two tasks in the IREX (Information Retrieval and Extraction Exercise) project, an evaluation-based project for Information Retrieval and Information Extraction in Japanese (Sekine and Isahara, 2000) (IREX Committee, 1999). The project started in 1998 and concluded in September 1999 with many participants and collaborators (45 groups in total from Japan and the US). In this paper, the Named Entity (NE) task is reported. It is a task to extract NE's, such as names of organizations, persons, locations and artifacts, time expressions and numeric expressions from newspaper articles. First, we will explain the task and the definition, as well as the data we created and the results. Second, the analyses of the results will be described, which include analysis of task difficulty across the NE types and system types, analysis of domain dependency and comparison to human performance.

• Type: Conference
• Year: 2000
• Where: COLING
• Authors: Satoshi Sekine, Yoshio Eriguchi
• Keywords: COLING 2000, COLING 2008, Extraction Exercise, Information Retrieval, IREX Committee