Practical Algorithms for Gathering Stored Correlated Data in a Network

—Many sensing systems remotely monitor/measure an environment at several sites, and then report these observations to a central site. We propose and investigate several practical algorithms for joint routing and compression of data files as they are forward from remote nodes to a central site, with the goal of minimizing the communication cost incurred. Our algorithms are practical in that they do not assume that nodes have a priori information about the correlation structure (and resulting compression gains) of the individual measurements at a given sensor or among multiple sensors. Instead, this correlation structure is learned as pieces of the files are routed and jointly compressed on their way to the sink, and routes are adaptively changed as the nodes learn more about the correlation structure of the data. We empirically evaluate the compressibility of two specific distributed data sources - trace files of packet headers taken simultaneously at two measurement points in a u...

• Type: Conference
• Year: 2008
• Where: SECON
• Authors: Ramin Khalili, James F. Kurose
• Keywords: Communications, Correlation Structure, Data files, Joint Routing, SECON 2008