A Hardware Algorithm for High Speed Morpheme Extraction and its Implementation

This paper describes a new hardware algorithm for morpheme extraction and its implementation on a specific machine (MEX-I), as the first step toward achieving natural language parsing accelerators. It also shows the machine's performance, 100-1,000 times fasterthan a personal computer. This machine can extract morphemes from 10,000 character Japanese text by searching an 80,000 morpheme dictionary in I second. It can treat multiple text streams, which are composed ofcharacter candidates, as well as one text stream. The algorithm isimplemented on the machine in linear time for the number of candidates, while conventional sequential algorithms are implemented in combinational time.

• Type: Conference
• Year: 1990
• Where: ACL
• Authors: Toshikazu Fukushima, Yutaka Ohyama, Hitoshi Miyai
• Keywords: ACL 1990, ACL 2007, Morpheme, Morpheme Extraction, Text Stream