Tracking the Changes of Dynamic Web Pages in the Existence of URL Rewriting

Crawlers in a knowledge management system need to collect and archive documents from websites, and also track the change status of these documents. However, the existence of URL rewriting mechanism raises a page tracking problem since the URLs of a pair of dynamic page instances obtained during different sessions will no longer be the same. This paper proposes a series of algorithms in a bottom-up manner to find the corresponding pairs of dynamic page instances, and then to judge the change status of them. Experiments showed that the performance was very good and the outcome was 100% accurate.

• Type: Conference
• Year: 2006
• Where: AUSDM
• Authors: Ping-Jer Yeh, Jie-Tsung Li, Shyan-Ming Yuan
• Keywords: AUSDM 2006, Change Status, Data Mining, Dynamic Page Instances, URL Rewriting Mechanism