Shadow-constrained shape-from-shading for pixel-wise 3D surface reconstruction at the lunar south pole

Abstract

High-resolution digital elevation models (DEMs) of the lunar surface are crucial for lunar exploration missions and scientific research. The emergence of advanced technologies, such as Shape-from-Shading (SfS), has enabled the generation of pixel-wise high-resolution DEMs from monocular images of the lunar surface. However, SfS encounters significant challenges in locations with limited illumination, such as the lunar south pole, where the surface is largely covered by shadows. Therefore, this paper presents a novel shadow-constrained SfS approach for pixel-wise 3D surface reconstruction at the lunar south pole. The proposed approach uses multiple high-resolution images captured under different illumination conditions and an existing low-resolution DEM as the inputs and generates a high-resolution DEM with the same resolution as that of the input image through hierarchical SfS processing incorporating shadow constraints. Experiments were conducted using actual images collected by the Lunar Reconnaissance Orbiter (LRO) Narrow Angle Camera (NAC) at the lunar south pole. Comparisons with respect to photogrammetric DEMs generated from stereo NAC images show that the DEMs generated using the proposed approach exhibit the smallest root mean square error (RMSE). Moreover, shaded relief images rendered from the DEMs generated using the proposed approach demonstrate the highest similarity to the actual NAC images. Detailed profile comparisons further validate the effectiveness of the shadow constraint in optimizing 3D reconstruction in regions in proximity to shadows and within shadowed regions. The proposed shadow-constrained SfS approach can be used to generate high-resolution DEMs to support future missions to explore the lunar south pole, with applications including landing site evaluation and route planning for lunar probes or astronauts.