Please use this identifier to cite or link to this item:
http://hdl.handle.net/10397/105676
Title: | Recover corrupted data in sensor networks : a matrix completion solution | Authors: | Xie, K Ning, X Wang, X Xie, D Cao, J Xie, G Wen, J |
Issue Date: | May-2017 | Source: | IEEE transactions on mobile computing, May 2017, v. 16, no. 5, p. 1434-1448 | Abstract: | Affected by hardware and wireless conditions in WSNs, raw sensory data usually have notable data loss and corruption. Existing studies mainly consider the interpolation of random missing data in the absence of the data corruption. There is also no strategy to handle the successive missing data. To address these problems, this paper proposes a novel approach based on matrix completion (MC) to recover the successive missing and corrupted data. By analyzing a large set of weather data collected from 196 sensors in Zhu Zhou, China, we verify that weather data have the features of low-rank, temporal stability, and spatial correlation. Moreover, from simulations on the real weather data, we also discover that successive data corruption not only seriously affects the accuracy of missing and corrupted data recovery but even pollutes the normal data when applying the matrix completion in a traditional way. Motivated by these observations, we propose a novel Principal Component Analysis (PCA)-based scheme to efficiently identify the existence of data corruption. We further propose a two-phase MC-based data recovery scheme, named MC-Two-Phase, which applies the matrix completion technique to fully exploit the inherent features of environmental data to recover the data matrix due to either data missing or corruption. Finally, the extensive simulations with real-world sensory data demonstrate that the proposed MC-Two-Phase approach can achieve very high recovery accuracy in the presence of successively missing and corrupted data. | Keywords: | Corrupted data recovery Matrix completion Wireless sensor networks |
Publisher: | Institute of Electrical and Electronics Engineers | Journal: | IEEE transactions on mobile computing | ISSN: | 1536-1233 | EISSN: | 1558-0660 | DOI: | 10.1109/TMC.2016.2595569 | Rights: | ©2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The following publication K. Xie et al., "Recover Corrupted Data in Sensor Networks: A Matrix Completion Solution," in IEEE Transactions on Mobile Computing, vol. 16, no. 5, pp. 1434-1448, 1 May 2017 is available at https://doi.org/10.1109/TMC.2016.2595569. |
Appears in Collections: | Journal/Magazine Article |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Cao_Recover_Corrupted_Data.pdf | Pre-Published version | 12.95 MB | Adobe PDF | View/Open |
Page views
50
Citations as of Jun 30, 2024
Downloads
37
Citations as of Jun 30, 2024
SCOPUSTM
Citations
102
Citations as of Jul 4, 2024
WEB OF SCIENCETM
Citations
96
Citations as of Jul 4, 2024
Google ScholarTM
Check
Altmetric
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.