Crawling Online Social Graphs

—Extensive research has been conducted on top of online social networks (OSNs), while little attention has been paid to the data collection process. Due to the large scale of OSNs and their privacy control policies, a partial data set is often used for analysis. The data set analyzed is decided by many factors including the choice of seeds, node selection algorithms, and the sample size. These factors may introduce biases and further contaminate or even skew the results. To evaluate the impact of different factors, this paper examines the OSN graph crawling problem, where the nodes are OSN users and the edges are the links (or relationship) among these users. More specifically, by looking at various factors in the crawling process, the following problems are addressed in this paper: • Efficiency: How fast different crawlers discover nodes/links; • Sensitivity: How different OSNs and the number of protected users affect crawlers; • Bias: How major graph properties are skewed. ...

• Type: Conference
• Year: 2010
• Where: APWEB
• Authors: Shaozhi Ye, Juan Lang, Shyhtsun Felix Wu
• Keywords: APWEB 2010, Data Set, Graph Crawling Problem, Internet Technology, Partial Data Set