Feedback-Directed Random Test Generation

We present a technique that improves random test generation by incorporating feedback obtained from executing test inputs as they are created. Our technique builds inputs incrementally by randomly selecting a method call to apply and finding arguments from among previously-constructed inputs. As soon as an input is built, it is executed and checked against a set of contracts and filters. The result of the execution determines whether the input is redundant, illegal, contract-violating, or useful for generating more inputs. The technique outputs a test suite consisting of unit tests for the classes under test. Passing tests can be used to ensure that code contracts are preserved across program changes; failing tests (that violate one or more contract) point to potential errors that should be corrected. Our experimental results indicate that feedback-directed random test generation can outperform systematic and undirected random test generation, in terms of coverage and error detection....

• Type: Conference
• Year: 2007
• Where: ICSE
• Authors: Carlos Pacheco, Shuvendu K. Lahiri, Michael D. Ernst, Thomas Ball
• Keywords: ICSE 2007, Random Test Generation, Software Engineering, Undirected Random Generation, Undirected Random Test