Distributed Representation of Syntactic Structure by Tensor Product Representation and Non-Linear Compression

Representing lexicons and sentences with the subsymbolic approach (using techniques such as Self Organizing Map (SOM) or Artificial Neural Network (ANN)) is a relatively new but important research area in natural language processing. The performance of this approach however, is highly dependent on whether representations are well formed so that members within each cluster are corresponding to sentences or phrases of similar meaning. Despite the moderate success and the rapid advancement of contemporary computing power, it is still difficult to establish an efficient learning method so that natural language can be represented in a way close to the benchmark exhibited by human beings. One of the major problems is due to the general lack of effective method(s) to encapsulate semantic information into quantitative expressions or structures. In this paper, we propose to alleviate this problem with a novel technique based on Tensor Product Representation and Non-linear Compression. The meth...

• Type: Conference
• Year: 2004
• Where: AAAI
• Authors: Heidi H. T. Yeung, Peter W. M. Tsang
• Keywords: AAAI 2004, Artificial Neural Network, Intelligent Agents, Natural Language, Self Organizing Map