VANET meets deep learning : the effect of packet loss on the object detection performance

Abstract

The integration of machine learning and inter- vehicle communications enables various active safety measures in internet-of-vehicles. Specifically, the environmental perception is processed by the deep learning module from vehicular sensor data, and the extended perception range is achieved by exchanging traffic-related information through inter-vehicle communications. Under such condition, the intelligent vehicles can not only percept the surrounding environment from self-collected sensor data, but also expand their perception range through the information sharing mechanism of Vehicular Ad-hoc Network (VANET). However, the dynamic urban environment in VANET leads to a number of issues, such as the effect of packet loss on the real-time perception accuracy of the received sensor data. In this work, we propose a point cloud object detection module via an end-to-end deep learning system and enable wireless communications between vehicles to enhance driving safety and facilitate real-time 3D mapping construction. Besides, we build a semi- realistic traffic scenario based on the Mong Kok district in Hong Kong to analyze the network performance of data dissemination under the dynamic environment. Finally, we evaluate the impact of data loss on the deep-learning-based object detection performance. Our results indicate that data loss beyond 50% (which is a common scene based on our simulation) can lead to a rapid decline of the object detection accuracy.