Test Oracles and Test Script Generation in Combinatorial Testing

Abstract

Combinatorial test design is a well-established practice for obtaining tests. Most approaches focus on the actual test generation and test size minimization. For execution of test cases, expected results and executable test scripts are required. We investigate both, how to determine expected results for test cases, ideally in an automated fashion, and ways for generic test script generation to allow for execution of combinatorial test suites. This paper provides a survey of current approaches to test oracles and test script generation in combinatorial testing. Illustration and running example is provided in terms of the Classification Tree Method.