Multi-level temporal feature fusion with feature exchange strategy for multiple object tracking

Abstract:

With the deepening of neural network research, object detection has been developed rapidly in recent years, and video object detection methods have gradually attracted the attention of scholars, especially frameworks including multiple object tracking and detection. Most current works prefer to build the paradigm for multiple object tracking and detection by multi-task learning. Different with others, a multi-level temporal feature fusion structure is pro-posed in this paper to improve the performance of framework by utilizing the constraint of video temporal con-sistency. For training the temporal network end-to-end, a feature exchange training strategy is put forward for training the temporal feature fusion structure efficiently. The proposed method is tested on several acknowledged benchmarks, and encouraging results are obtained compared with the famous joint detection and tracking frame-work. The ablation experiment answers the problem of a good position for temporal feature fusion.

Key words:Joint detection and tracking framework, multiple object tracking, artificial neural network, temporal feature fusion