Web document text and images extraction using DOM analysis and natural language processing

: © Web Document Text and Images Extraction using DOM Analysis and Natural Language Processing Parag Mulendra Joshi, Sam Liu HP Laboratories HPL-2009-187 Web page text extraction, Image extraction, Natural language processing, HTML documents, DOM trees Web has emerged as the most important source of information in the world. This has resulted in need for automated software components to analyze web pages and harvest useful information from them. However, in typical web pages the informative content is surrounded by a very high degree of noise in the form of advertisements, navigation bars, links to other content, etc. Often the noisy content is interspersed with the main content leaving no clean boundaries between them. This noisy content makes the problem of information harvesting from web pages much harder. Therefore, it is essential to be able to identify main content of a web page and automatically isolate it from noisy content for any further analysis. Most existing approaches re...

• Type: Conference
• Year: 2009
• Where: DOCENG
• Authors: Parag Mulendra Joshi, Sam Liu
• Keywords: DOCENG 2009, Document Analysis , Natural Language Processing, Noisy Content, Web Pages