A new object-class based gap-filling method for PlanetScope satellite image time series

Abstract

PlanetScope CubeSats data with a 3-m resolution, frequent revisits, and global coverage have provided an unprecedented opportunity to advance land surface monitoring over the recent years. Similar to other optical satellites, cloud-induced data missing in PlanetScope satellites substantially hinders its use for broad applications. However, effective gap-filling in PlanetScope image time series remains challenging and is subject to whether it can 1) consistently generate high accuracy results regardless of different gap sizes, especially for heterogeneous landscapes, and 2) effectively recover the missing pixels associated with rapid land cover changes. To address these challenges, we proposed an object-class based gap-filling (‘OCBGF’) method. Two major novelties of OCBGF include 1) adopting an object-based segmentation method in conjunction with an unsupervised classification method to help characterize the landscape heterogeneity and facilitate the search of neighboring valid pixels for gap-filling, improving its applicability regardless of the gap size; 2) employing a scenario-specific gap-filling approach that enables effective gap-filling of areas with rapid land cover change. We tested OCBGF at four sites representative of different land cover types (plantation, cropland, urban, and forest). For each site, we evaluated the performance of OCBGF on both simulated and real cloud-contaminated scenarios, and compared our results with three state-of-the-art methods, namely Neighborhood Similar Pixel Interpolator (NSPI), AutoRegression to Remove Clouds (ARRC), and Spectral-Angle-Mapper Based Spatio-Temporal Similarity (SAMSTS). Our results show that across all four sites, OCBGF consistently obtains the highest accuracy in gap-filling when applied to scenarios with various gap sizes (RMSE = 0.0065, 0.0090, 0.0092, and 0.0113 for OCBGF, SAMSTS, ARRC, and NSPI, respectively) and with/without rapid land cover changes (RMSE = 0.0082, 0.0112, 0.0119, and 0.0120 for OCBGF, SAMSTS, ARRC, and NSPI, respectively). These results demonstrate the effectiveness of OCBGF for gap-filling PlanetScope image time series, with potential to be extended to other satellites.