An Industrial Case Study on Speeding Up User Acceptance Testing by Mining Execution Logs

—Software reliability is defined as the probability of failure-free operation for a period of time, under certain conditions. To determine whether the reliability of an application satisfies the reliability requirements, User Acceptance Testing is performed at deployment sites. To support the wide variation in configurations and usage patterns, User Acceptance Testing has become a crucial step in large deployments of mission-critical applications. However, verifying the long-term reliability of an application requires lengthy on-site engagements and dedicated use of costly lab setups. In this paper, we propose a technique to reduce the time and cost needed for User Acceptance Testing. We use a repository of execution logs from related deployments and prior tests of the application to mine reliability estimates. We then customize these estimates by mining logs generated from a limited-time User Acceptance Test (i.e., one day of testing) instead of from traditionally longer tests (e...

• Type: Conference
• Year: 2010
• Where: SSIRI
• Authors: Zhen Ming Jiang, Alberto Avritzer, Emad Shihab, Ahmed E. Hassan, Parminder Flora
• Keywords: Reliability Estimate, Software Engineering, SSIRI 2010, User Acceptance, User Acceptance Testing