Research on Multi-Target Detection and Tracking of Intelligent Vehicles in Complex Traffic Environments Based on Deep Learning Theory

Xuewen Chen, Shilong Yan, Chenxi Xia

To address the issues of missed detections and false detections of small target missed detections caused by dense occlusion in complex traffic environments, a non-maximum suppression method, Bot-NMS, is proposed to achieve accurate prediction and localization of occluded targets. In the backbone network of YOLOv7, the Ghost module, the ECA attention mechanism, and the multi-scale feature detection structure are introduced to enhance the network’s capacity to learn small target features. The SCSTD and KITTI datasets were used to train and test the improved YOLOv7 target detection network model. The results demonstrate that the improved YOLOv7 method significantly enhances the recall rate and detection accuracy of various targets. A multi-target tracking method based on target re-identification (ReID) is proposed. Utilizing deep learning theory, a ReID model for target identification is constructed to comprehensively capture global and foreground target features. By establishing the correlation cost matrix of the cosine distance and IoU overlap, the correlation between target detection objects, the tracking trajectory, and ReID feature similarity is realized. The VERI-776 vehicle re-identification dataset and MARKET1501 pedestrian re-identification dataset were used to train the proposed ReID model, and multi-target tracking performance comparison experiments were conducted on the MOT16 dataset. The results show that the multi-target tracking method by introducing the ReID model and improving the cost matrix can better deal with the dense occlusion of the target, and can effectively and accurately track the road target in the realistic complex traffic environment.