Fa: A System for Automating Failure Diagnosis

Abstract-Failures of Internet services and enterprise systems lead to user dissatisfaction and considerable loss of revenue. Since manual diagnosis is often laborious and slow, there is considerable interest in tools that can diagnose the cause of failures quickly and automatically from system-monitoring data. This paper identifies two key data-mining problems arising in a platform for automated diagnosis called Fa. Fa uses monitoring data to construct a database of failure signatures against which data from undiagnosed failures can be matched. Two novel challenges we address are to make signatures robust to the noisy monitoring data in production systems, and to generate reliable confidence estimates for matches. Fa uses a new technique called anomalybased clustering when the signature database has no highconfidence match for an undiagnosed failure. This technique clusters monitoring data based on how it differs from the failure data, and pinpoints attributes linked to the failure. We...

• Type: Conference
• Year: 2009
• Where: ICDE
• Authors: Songyun Duan, Shivnath Babu, Kamesh Munagala
• Keywords: Clusters Monitoring Data, Database, Diagnosis Called Fa, Failure Data, ICDE 2009, Noisy Monitoring Data, Undiagnosed Failures