IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (Jan 2024)

Satellite Videos Object Tracking Based on Enhanced Correlation Filter With Motion Prediction Network

  • Puhua Chen,
  • Lu Wang,
  • Lei Guo,
  • Xu Liu,
  • Xiangrong Zhang,
  • Licheng Jiao,
  • Fang Liu

DOI
https://doi.org/10.1109/JSTARS.2024.3421951
Journal volume & issue
Vol. 17
pp. 12123 – 12137

Abstract

Read online

With the maturity of satellite imaging technology, satellite video has attracted more and more attention because of high spatial resolution and temporal resolution. Thus, object tracking as the main application task of satellite videos also becomes a popular research topic. Compared to natural videos, the difficulties of satellite videos object tracking mainly are caused by feature deficiency of small objectives, surroundings, occlusion (OCC), etc. In this article, based on a dual correlation filter (DCF) tracking framework, a new object tracking method for satellite videos is proposed to deal with the above-mentioned problems. For feature deficiency problem, the proposed super-resolution feature enhancement module could improve the feature discriminative ability of objects utilizing the prior information learned by a super-resolution network. For the OCC problem, a multilayer perceptron motion prediction network is designed to predict the position of objects when OCC occurs, which uses an online training strategy. Besides, KNN background subtraction also is introduced to reduce the interference of surroundings. Finally, these above-mentioned processes are combined together appropriately on the DCF tracking framework for better tracking results. Aiming to verify the performance of the proposed method, abundant experiments have been conducted on satellite video datasets. The experimental results show that the design of the proposed tracking method is effective and it also has a conspicuous advantage compared with some state-of-the-art methods.

Keywords