Please use this identifier to cite or link to this item: http://hdl.handle.net/10397/22805
Title: Finding conclusion stability for selecting the best effort predictor in software effort estimation
Authors: Keung, J
Kocaguneli, E
Menzies, T
Keywords: Analogy
Data mining
Effort estimation
Evaluation criteria
Linear regression
MMRE
Neural nets
Regression trees
Stability
Issue Date: 2012
Publisher: Springer
Source: Automated software engineering, 2012, p. 1-25 How to cite?
Journal: Automated Software Engineering 
Abstract: Background:Conclusion Instability in software effort estimation (SEE) refers to the inconsistent results produced by a diversity of predictors using different datasets. This is largely due to the "ranking instability" problem, which is highly related to the evaluation criteria and the subset of the data being used. Aim: To determine stable rankings of different predictors. Method: 90 predictors are used with 20 datasets and evaluated using 7 performance measures, whose results are subject to Wilcoxon rank test (95 %). These results are called the "aggregate results". The aggregate results are challenged by a sanity check, which focuses on a single error measure (MRE) and uses a newly developed evaluation algorithm called CLUSTER. These results are called the "specific results." Results: Aggregate results show that: (1) It is now possible to draw stable conclusions about the relative performance of SEE predictors; (2) Regression trees or analogy-based methods are the best performers. The aggregate results are also confirmed by the specific results of the sanity check. Conclusion: This study offers means to address the conclusion instability issue in SEE, which is an important finding for empirical software engineering.
URI: http://hdl.handle.net/10397/22805
ISSN: 0928-8910
DOI: 10.1007/s10515-012-0108-5
Appears in Collections:Journal/Magazine Article

Access
View full-text via PolyU eLinks SFX Query
Show full item record

SCOPUSTM   
Citations

32
Last Week
0
Last month
1
Citations as of Nov 3, 2018

WEB OF SCIENCETM
Citations

29
Last Week
0
Last month
0
Citations as of Oct 17, 2018

Page view(s)

89
Last Week
2
Last month
Citations as of Nov 11, 2018

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.