Anatomy-inspired model for critical landmark localization in 3D spinal ultrasound volume data

Abstract

Three-dimensional (3D) spinal ultrasound imaging has demonstrated its promising potential in measuring spinal deformity through recent studies, and it is more suitable for massive early screening and longitudinal follow-up of adolescent idiopathic scoliosis (AIS) compared with X-ray imaging due to its radiation-free superiority. Moreover, some deformities with low observability, such as vertebral rotation, in X-ray images can also be reflected by critical landmarks in 3D ultrasound data. In this paper, we propose a localization network (LLNet) to extract lamina in 3D ultrasound data, which has been indicated as a meaningful anatomy for measuring vertebral rotation by clinical studies. First, the LLNet skillfully establishes a parallel anatomical prior embedding branch that implicitly explores the anatomical correlation between the lamina and another anatomy with more stable observability (spinous process) during the training phase and then introduces the correlation to highlight the potential region of the lamina in the inferring one. Second, since the lamina is a tiny target, the information loss caused by continuous convolutional and pooling operations has a profound negative effect on detecting the lamina. We employ an optimization mechanism to mitigate this problem, which refines feature maps according to information from the original image and further reuses them to polish output. Furthermore, a modified global-local attention module is deployed on skip connections to mine global dependencies and contextual information to construct an effective image pattern. Extensive comparisons and ablation studies are performed on actual clinical data. Results indicate that the capability of our model is better than other outstanding detection models, and functional modules effectively contribute to this, with a 100.0 % detection success rate and an 8.9 % improvement of mean intersection over the union. Thus, our model is promising to become a helpful part of a computer-assisted diagnosis system based on 3D spinal ultrasound imaging.