UPCommons. Portal del coneixement obert de la UPC
Publication
Artículo científico (JournalArticle)
Co3DCAE: feature compression for intermediate fusion collaborative perception for autonomous driving
In recent years, multi-agent sensing technology has attracted considerable attention, particularly in the field of vehicle-to-vehicle (V2V) collaborative perception for autonomous driving. By sharing complementary information, connected autonomous vehicles (CAVs) can significantly improve scene understanding. However, this collaboration also presents challenges, such as balancing data transmission efficiency with the accuracy of environmental perception. To address these issues, we propose an autoencoder based on intermediate-level feature fusion. Specifically, we design a 3D convolutional autoencoder with a residual structure to maximize the compression of inter-vehicle bandwidth usage while retaining essential feature information. By encoding the spatial-channel dimensions of intermediate feature maps extracted from point clouds, network bandwidth is reduced by 3–10× under different configurations. Additionally, we propose a channel-wise autoencoder training strategy to reduce model parameters and enhance feature compression efficiency, while preserving collaborative perception performance. Finally, we conduct a comprehensive evaluation of perception accuracy and bandwidth consumption using a collaborative detection dataset collected via LiDAR. Extensive experimental results demonstrate that our method offers significant advantages in balancing object detection accuracy and bandwidth compression for CAVs., This work was partially supported by the Spanish Research Agency (AEI) under project PID2020-117142GB-I00 of the call MCIN/ AEI /10.13039/501100011033 and by the 6G-EWOC project from the Smart Networks and Services Joint Undertaking (SNS JU) under the European Union’s Horizon Europe research and innovation programme under Grant Agreement No. 101139182., Peer Reviewed