Error Log Processing for Accurate Failure Prediction

Error logs are a fruitful source of information both for diagnosis as well as for proactive fault handling ? however elaborate data preparation is necessary to filter out valuable pieces of information. In addition to the usage of well-known techniques, we propose three algorithms: (a) assignment of error IDs to error messages based on Levenshtein's edit distance, (b) a clustering approach to group similar error sequences, and (c) a statistical noise filtering algorithm. By experiments using data of a commercial telecommunication system we show that data preparation is an important step to achieve accurate error-based online failure prediction.

• Type: Conference
• Year: 2008
• Where: OSDI
• Authors: Felix Salfner, Steffen Tschirpke
• Keywords: Error Ids, Error Logs, Operating System, OSDI 2008, Similar Error Sequences