Correlation filter tracking based on superpixel and multifeature fusion

Abstract:

For the correlation filtering (CF) tracking algorithm is not robust enough and cannot adapt to scale changes, target occlusion (OCC) and other complex interferences. We introduce a CF tracking algorithm based on superpixel and multifeature fusion (CFSMF). First, superpixel segmentation and clustering are performed for the target and its surrounding environment in the initial frame. Then, a target appearance is reconstructed through block segmentation-based overlapping analysis to remove redundant information. On this basis, the histogram of gradient (HOG) and HSI color features of the target sub-block are extracted to interact with their respective position filters. Accordingly, the target position is determined by the weighted fusion of the response values. In the scale prediction stage, we independently train a scale filter with a multiscale pyramid constructed at the estimated target location. The object scale is estimated in terms of the filter response, thereby enabling the tracking algorithm to adapt to the object scale change. Lastly, we introduce an OCC criterion for determining whether to update the model or not. Compared with the classical tracking algorithm kernelized correlation filters (KCF), the proposed algorithm boosts the tracking success rate by 20% and tracking accuracy by 15.9%. Our algorithm in this paper could track the target stably even when the target is occluded and its scale changes. This work has been supported in part by the National Key Research and Development Project of China (No.2018YFB1601200), the Key Projects of the Civil Aviation Joint Fund of the National Natural Science Foundation of China (No.U1533203), and the Fundamental Research Funds for the Central Universities (No.3122018C004). E-mail:[e-mail]