Towards an Error-Free Stemming

S Stemming is a fundamental step in processing textual data preceding the tasks of information retrieval, text mining, and natural language processing. The common goal of stemming is to standardize words by reducing a word to its base. However, simply removing the suffix of the word can cause stemming errors such as under-stemming or over-stemming. Sophisticated stemmers tend to weakly stem documents with very computationally expensive approaches such as dictionary lookup. This paper presents a new dictionary free, simple, highly effective stemmer that can reduce stemming errors in addition to decreasing computational time and data storage. KEYWORDS Pre-processing, Stemming, Algorithm, English

• Type: Conference
• Year: 2008
• Where: IADIS
• Authors: Eiman Tamah Al-Shammari
• Keywords: Fundamental Step, IADIS 2008, Internet Technology, Natural Language Processing, Stemming Errors