Using Wide Table to manage web data: a survey

With the development of World Wide Web (WWW), storage and utilization of web data has become a big challenge for data management research community. Web data are essentially heterogeneous data, and may change schema frequently, traditional relational data model is inappropriate for web data management. A new data model, called Wide Table (or WT for simplicity), was introduced for this task. There are several characteristics of the WT model. First, WT is usually highly sparsely populated so that most data can be fit into a line or record. Second, queries are composed on only a small subset of the attributes. Thus, existing query processing and optimization techniques for relational database with normalized tables will not work efficiently anymore. Furthermore, WT is usually of extremely large volume. It is thought that only largescale distributed storage can accommodate the massive data set. In this paper, requirements and challenges to web data management are discussed. Existing techni...

• Type: Journal
• Year: 2008
• Where: FCSC
• Authors: Bin Yang 0002, Weining Qian, Aoying Zhou
• Keywords: Data Management, FCSC 2008, Web Data, Web Data Management