Algorithms for Low-Latency Remote File Synchronization

The remote file synchronization problem is how to update an outdated version of a file located on one machine to the current version located on another machine with a minimal amount of network communication. It arises in many scenarios including web site mirroring, file system backup and replication, or web access over slow links. A widely used open-source tool called rsync uses a single round of messages to solve this problem (plus an initial round for exchanging meta information). While research has shown that significant additional savings in bandwidth are possible by using multiple rounds, such approaches are often not desirable due to network latencies, increased protocol complexity, and higher I/O and CPU overheads at the endpoints. In this paper, we study single-round synchronization techniques that achieve savings in bandwidth consumption while preserving many of the advantages of the rsync approach. In particular, we propose a new and simple algorithm for file synchroniz...

• Type: Conference
• Year: 2008
• Where: INFOCOM
• Authors: Hao Yan, Utku Irmak, Torsten Suel
• Keywords: Communications, Data Sets, INFOCOM 2008, file Synchronization, file Synchronization Problem