Online detection of utility cloud anomalies using metric distributions

—The online detection of anomalies is a vital element of operations in data centers and in utility clouds like Amazon EC2. Given ever-increasing data center sizes coupled with the complexities of systems software, applications, and workload patterns, such anomaly detection must operate automatically, at runtime, and without the need for prior knowledge about normal or anomalous behaviors. Further, detection should function for t levels of abstraction like hardware and software, and for the multiple metrics used in cloud computing systems. This paper proposes EbAT – Entropy-based Anomaly Testing – offering novel methods that detect anomalies by analyzing for arbitrary metrics their distributions rather than individual metric thresholds. Entropy is used as a measurement that captures the degree of dispersal or concentration of such distributions, aggregating raw metric data across the cloud stack to form entropy time series. For scalability, such time series can then be combined hi...

• Type: Journal
• Year: 2010
• Where: NOMS
• Authors: Chengwei Wang, Vanish Talwar, Karsten Schwan, Parthasarathy Ranganathan
• Keywords: Anomaly Detection, Cloud, Communications, Data Center, NOMS 2010