Please use this identifier to cite or link to this item: http://hdl.handle.net/10397/62304
Title: Mining significant association rules from uncertain data
Authors: Zhang, A
Shi, WZ 
Webb, GI
Keywords: Pattern discovery
Association rules
Statistical evaluation
Uncertain data
Issue Date: 2016
Publisher: Springer
Source: Data mining and knowledge discovery, 2016, v. 30, no. 4, p. 928-963 How to cite?
Journal: Data mining and knowledge discovery 
Abstract: In association rule mining, the trade-off between avoiding harmful spurious rules and preserving authentic ones is an ever critical barrier to obtaining reliable and useful results. The statistically sound technique for evaluating statistical significance of association rules is superior in preventing spurious rules, yet can also cause severe loss of true rules in presence of data error. This study presents a new and improved method for statistical test on association rules with uncertain erroneous data. An original mathematical model was established to describe data error propagation through computational procedures of the statistical test. Based on the error model, a scheme combining analytic and simulative processes was designed to correct the statistical test for distortions caused by data error. Experiments on both synthetic and real-world data show that the method significantly recovers the loss in true rules (reduces type-2 error) due to data error occurring in original statistically sound method. Meanwhile, the new method maintains effective control over the familywise error rate, which is the distinctive advantage of the original statistically sound technique. Furthermore, the method is robust against inaccurate data error probability information and situations not fulfilling the commonly accepted assumption on independent error probabilities of different data items. The method is particularly effective for rules which were most practically meaningful yet sensitive to data error. The method proves promising in enhancing values of association rule mining results and helping users make correct decisions.
URI: http://hdl.handle.net/10397/62304
ISSN: 1384-5810
DOI: 10.1007/s10618-015-0446-6
Appears in Collections:Journal/Magazine Article

Access
View full-text via PolyU eLinks SFX Query
Show full item record

SCOPUSTM   
Citations

1
Last Week
0
Last month
Citations as of Oct 17, 2017

Page view(s)

37
Last Week
0
Last month
Checked on Oct 15, 2017

Google ScholarTM

Check

Altmetric



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.