Please use this identifier to cite or link to this item: http://hdl.handle.net/10397/28205
Title: An empirical evaluation of several test-a-few strategies for testing particular conditions
Authors: Chan, EYK
Chan, WK
Poon, PL 
Yu, YT
Keywords: particular condition
software testing
software validation
test case selection
test-a-few strategy
test-once strategy
Issue Date: 2012
Publisher: Wiley-Blackwell
Source: Software - practice and experience, 2012, v. 42, no. 8, p. 967-994 How to cite?
Journal: Software - Practice and Experience 
Abstract: Existing specification-based testing techniques often generate comprehensive test suites to cover diverse combinations of test-relevant aspects. Such a test suite can be prohibitively expensive to execute exhaustively because of its large size. A pragmatic strategy often adopted in practice, called test-once strategy, is to identify certain particular conditions from the specification and to test each such condition once only. This strategy is implicitly based on the uniformity assumption that the implementation will process a particular condition uniformly, regardless of other parameters or inputs. As the decision of adopting the test-once strategy is often based on the specification, whether the uniformity assumption actually holds in the implementation needs to be critically assessed, or else the risk of inadequate testing could be non-negligible. As viable alternatives to reduce such a risk, a family of test-a-few strategies for the testing of particular conditions is proposed in this paper. Two rounds of experiments that evaluate the effectiveness of the test-a-few strategies as compared with the test-once strategy are further reported. Our experiments do the following: (1) provide clear evidence that the uniformity assumption often, but not always, holds and that the assumption usually fails to hold when the implementation is faulty; (2) demonstrate that all our proposed test-a-few strategies are statistically more reliable than the test-once strategy in revealing faulty programs; (3) show that random sampling is already substantially more effective than the test-once strategy; and (4) indicate that, compared with other test-a-few strategies under study, choice coverage seems to achieve a better trade-off between test effort and effectiveness.
URI: http://hdl.handle.net/10397/28205
ISSN: 0038-0644
DOI: 10.1002/spe.1098
Appears in Collections:Journal/Magazine Article

Access
View full-text via PolyU eLinks SFX Query
Show full item record

SCOPUSTM   
Citations

2
Last Week
0
Last month
0
Citations as of Feb 11, 2018

WEB OF SCIENCETM
Citations

1
Last Week
0
Last month
0
Citations as of Feb 15, 2018

Page view(s)

81
Last Week
7
Last month
Citations as of Feb 19, 2018

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.