Large-scale Data Collection: a Coordinated Approach

— In this paper we consider the problem of collecting a large amount of data from several different hosts to a single destination in a wide-area network. Often, due to congestion conditions, the paths chosen by the network may have poor throughput. By choosing an alternate route at the application level, we may be able to obtain substantially faster completion time. This data collection problem is a non-trivial one because the issue is not only to avoid congested link(s), but to devise a coordinated transfer schedule which would afford maximum possible utilization of available network resources. In this paper we present an approach for computing coordinated data collection schedules, which can result in significant performance improvements. We make no assumptions about knowledge of the topology of the network or the capacity available on individual links of the network, i.e., we only use end-to-end information. Finally, we also study the shortcomings of this approach in terms of the...

• Type: Conference
• Year: 2003
• Where: INFOCOM
• Authors: William C. Cheng, Cheng-Fu Chou, Leana Golubchik, Samir Khuller, Yung-Chun (Justin) Wan
• Keywords: Communications, Data Collection, Data Collection Problem, INFOCOM 2003, Wide-area Networks