We carry out a longitudinal study of evolution of small-time scaling behavior of Internet traffic on the MAWI dataset spanning 8 years. MAWI dataset contains a number of anomalies which interfere with the correct identification of scaling behavior, and hence to mitigate these effects, we use a sketch-based procedure for robust estimation of scaling exponent. We first show the importance of robust estimation procedure while studying small-time scaling behavior of Internet traffic. We further study the evolution of the following properties concerning the origins of small-time scaling behavior: (1) Scaling at IP level is independent of flow arrivals and (2) Dense flows are primary correlationcausing factor in small time scales. Traditionally these properties have been shown to hold by using a semi-experiments based methodology. We next show that due to network anomalies, semi-experiments can result in misleading inferences. Hence we propose and motivate the use of "robust semi-experi...
Himanshu Gupta, Vinay J. Ribeiro, Anirban Mahanti