Pitfalls for testbed evaluations of internet systems

Today's open platforms for network measurement and distributed system research, which we collectively refer to as testbeds in this article, provide opportunities for controllable experimentation and evaluations of systems at the scale of hundreds or thousands of hosts. In this article, we identify several issues with extending results from such platforms to Internet wide perspectives. Specifically, we try to quantify the level of inaccuracy and incompleteness of testbed results when applied to the context of a large-scale peerto-peer (P2P) system. Based on our results, we emphasize the importance of measurements in the appropriate environment when evaluating Internet-scale systems. Categories and Subject Descriptors C.2.5 [Communication Networks]: Local and Wide-Area Networks

• Type: Journal
• Year: 2010
• Where: CCR
• Authors: David R. Choffnes, Fabian E. Bustamante
• Keywords: CCR 2010, Internet-scale Systems, Measurements, Network Measurement