Automated and Scalable T-wise Test Case Generation Strategies for Software Product Lines

Abstract—Software Product Lines (SPL) are difficult to validate due to combinatorics induced by variability across their features. This leads to combinatorial explosion of the number of derivable products. Exhaustive testing in such a large space of products is infeasible. One possible option is to test SPLs by generating test cases that cover all possible T feature interactions (T-wise). T-wise dramatically reduces the number of test products while ensuring reasonable SPL coverage. However, automatic generation of test cases satisfying T-wise using SAT solvers raises two issues. The encoding of SPL models and Twise criteria into a set of formulas acceptable by the solver and their satisfaction which fails when processed “all-at-once”. We propose a scalable toolset using Alloy to automatically generate test cases satisfying T-wise from SPL models. We define strategies to split T-wise combinations into solvable subsets. We design and compute metrics to evaluate strategies on Asp...

• Type: Journal
• Year: 2010
• Where: ICST
• Authors: Gilles Perrouin, Sagar Sen, Jacques Klein, Benoit Baudry, Yves Le Traon
• Keywords: ICST 2010, Reasonable Spl Coverage, Software Engineering, SPL Models, Test Cases