Please use this identifier to cite or link to this item: http://hdl.handle.net/10397/11011
Title: A survey of combinatorial testing
Authors: Nie, C
Leung, H 
Keywords: Combinatorial testing (CT)
Covering array
Software testing
Test case generation
Issue Date: 2011
Publisher: Assoc Computing Machinery
Source: Acm computing surveys, 2011, v. 43, no. 2, 11 How to cite?
Journal: ACM Computing Surveys 
Abstract: Combinatorial Testing (CT) can detect failures triggered by interactions of parameters in the Software Under Test (SUT) with a covering array test suite generated by some sampling mechanisms. It has been an active field of research in the last twenty years. This article aims to review previous work on CT, highlights the evolution of CT, and identifies important issues, methods, and applications of CT, with the goal of supporting and directing future practice and research in this area. First, we present the basic concepts and notations of CT. Second, we classify the research on CT into the following categories: modeling for CT, test suite generation, constraints, failure diagnosis, prioritization, metric, evaluation, testing procedure and the application of CT. For each of the categories, we survey the motivation, key issues, solutions, and the current state of research. Then, we review the contribution from different research groups, and present the growing trend of CT research. Finally, we recommend directions for future CT research, including: (1) modeling for CT, (2) improving the existing test suite generation algorithm, (3) improving analysis of testing result, (4) exploring the application of CT to different levels of testing and additional types of systems, (5) conducting more empirical studies to fully understand limitations and strengths of CT, and (6) combining CT with other testing techniques.
URI: http://hdl.handle.net/10397/11011
DOI: 10.1145/1883612.1883618
Appears in Collections:Journal/Magazine Article

Access
View full-text via PolyU eLinks SFX Query
Show full item record

SCOPUSTM   
Citations

261
Last Week
2
Last month
5
Citations as of Sep 23, 2017

WEB OF SCIENCETM
Citations

121
Last Week
0
Last month
1
Citations as of Sep 21, 2017

Page view(s)

57
Last Week
0
Last month
Checked on Sep 24, 2017

Google ScholarTM

Check

Altmetric



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.