Please use this identifier to cite or link to this item:
http://hdl.handle.net/10397/106952
Title: | A hybrid evolutionary preprocessing method for imbalanced datasets | Authors: | Wong, GY Leung, FHF Ling, SH |
Issue Date: | Jul-2018 | Source: | Information sciences, July 2018, v. 454-455, p. 161-177 | Abstract: | Imbalanced datasets are commonly encountered in real-world classification problems. Many machine learning algorithms are originally designed for well-balanced datasets, therefore re-sampling has become an important step to pre-process imbalanced data. This aims to balance the datasets by increasing the samples of the smaller class or decreasing the samples of the larger class, which are known as over-sampling and under-sampling, respectively. In this paper, a sampling strategy that is based on both over-sampling and under-sampling is proposed, in which the new samples of the smaller class are created based on fuzzy logic. Improvement of the datasets is done by the evolutionary computational method of Cross-generational elitist selection, Heterogeneous recombination and Cataclysmic mutation (CHC) that under-samples both the minority and majority samples. Consequently, a hybrid preprocessing method is proposed to re-sample imbalanced datasets. The evaluation is done by applying the Support Vector Machine (SVM), C4.5 decision tree and nearest neighbor rule to train a classification model from the re-sampled training sets. From the experimental results, it can be seen that our proposed method im- proves both the F −measure and AUC. The over-sampling rate and complexity of the classification model are also compared. Our proposed method is found to be superior to all other methods under comparison and it is more robust in different classifiers. | Publisher: | Elsevier Inc. | Journal: | Information sciences | ISSN: | 0020-0255 | EISSN: | 1872-6291 | DOI: | 10.1016/j.ins.2018.04.068 | Rights: | © 2018 Published by Elsevier Inc. ©2018. This manuscript version is made available under the CC-BY-NC-ND 4.0 license https://creativecommons.org/licenses/by-nc-nd/4.0/ The following publication Wong, G. Y., Leung, F. H., & Ling, S. H. (2018). A hybrid evolutionary preprocessing method for imbalanced datasets. Information Sciences, 454, 161-177 is available at https://doi.org/10.1016/j.ins.2018.04.068. |
Appears in Collections: | Journal/Magazine Article |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Leung_Hybrid_Evolutionary_Preprocessing.pdf | Pre-Published version | 1.42 MB | Adobe PDF | View/Open |
Page views
5
Citations as of Jun 30, 2024
Downloads
2
Citations as of Jun 30, 2024
SCOPUSTM
Citations
43
Citations as of Jun 21, 2024
WEB OF SCIENCETM
Citations
34
Citations as of Jun 27, 2024
![](/image/google_scholar.jpg)
Google ScholarTM
Check
Altmetric
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.