A Corpus for Evaluating Semantic Multilingual Web Retrieval Systems: The Sense Folder Corpus

In this paper, we present the multilingual Sense Folder Corpus. After the analysis of different corpora, we describe the requirements that have to be satisfied for evaluating semantic multilingual retrieval approaches. Justified by the unfulfilled requirements explained, we start creating a small bilingual hand-tagged corpus of 502 documents retrieved from Web searches. The documents contained in this collection have been created using Google queries. A single ambiguous word has been searched and related documents (approx. the first 60 documents for every keyword) have been retrieved. The document collection has been extended at the query word level, using single ambiguous words for English (argument, bank, chair, network and rule) and for Italian (argomento, lingua, regola, rete and stampa). The search and annotation process has been done both in a monolingual way for the English and the Italian language. 252 English and 250 Italian documents have been retrieved from Google and saved...

• Type: Conference
• Year: 2010
• Where: LREC
• Authors: Ernesto William De Luca
• Keywords: Documents, Education, LREC 2010, Semantic Multilingual Retrieval, Single Ambiguous Words