Study of visual object tracking methods based on siamese neural network architecture
Keywords:
Computer Vision, Object Tracking, Deep Learning, Siamese Neural NetworksAbstract
Visual object tracking has become one of the most active research topics in computer vision, which has been growing in commercial development as well as academic research. Deep learning technologies have significantly advanced the task of visual object tracking, by providing the strong capacity of learning powerful deep features. Siamese-based trackers have achieved excellent performance on visual object tracking. This survey presents a deep analysis of the learning and inference capabilities of eight trackers based on Siamese neural networks in recent years. Quantitative results from eight papers are compared on popular visual tracking benchmarks OTB2015, UAV123, VOT2018, LaSOT.
References
C. Robin and S. Lacroix, “Multi-robot target detection and tracking: Taxonomy and survey,” Autonomous Robots, vol. 40, no. 4, pp. 729-760, 2016.
K. Lee, J. Hwang, G. Okopal, and J. Pitton, “Ground-moving-platform-based human tracking using visual SLAM and constrained multiple kernels,” IEEE Trans. Intell. Transp. Sys., vol. 17, no. 12, pp. 3602-3612, 2016.
M. Gao, L. Jin, Y. Jiang, and B. Guo, “Manifold Siamese network: Anovel visual tracking ConvNet for autonomous vehicles,” IEEE Trans.Intell. Transp. Sys., pp. 1-12, 2019.
J. Hao, Y. Zhou, G. Zhang, Q. Lv, and Q. Wu, “A review of target tracking algorithm based on UAV,” in Proc. IEEE CBS, 2019, pp. 328-333.
M. Fiaz, A. Mahmood, and S. K. Jung, “Tracking noisy targets: A review of recent object tracking approaches,” 2018. [Online]. Available: http://arxiv.org/abs/1802.03098
M. Fiaz, A. Mahmood, S. Javed, and S. K. Jung, “Handcrafted and deep trackers: Recent visual object tracking approaches and trends,” ACM Computing Surveys, 2019.
P. Li, D. Wang, L. Wang, and H. Lu, “Deep visual tracking: Review and experimental comparison,” Pattern Recognit., vol. 76, pp. 323-338,2018.
Abbass, Mohammed Y., Ki-Chul Kwon, Nam Kim, Safey A. Abdelwahab, Fathi E. Abd El-Samie, and Ashraf AM Khalaf. “A survey on online learning for visual tracking,” The Visual Computer (2020): 1-22.
R. Pflugfelder, “An in-depth analysis of visual tracking with Siamese neural networks,” 2017. [Online]. Available: http://arxiv.org/abs/1707.00569.
Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll´ar, P., Zitnick, C.L. “Microsoft coco: Common objects in context,”. In ECCV 2014, pp. 740-755.
O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei, “ImageNet large scale visual recognition challenge,” IJCV, vol. 115, no. 3, pp. 211-252, 2015.
E. Real, J. Shlens, S. Mazzocchi, X. Pan, and V. Vanhoucke, “YouTube-BoundingBoxes: A large high-precision human-annotated data set forobject detection in video,” in Proc. IEEE CVPR, 2017, pp. 7464-7473.
Y. Wu, J. Lim, and M. Yang, “Object tracking benchmark,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 9, pp. 1834-848, 2015.
M. Mueller, N. Smith, and B. Ghanem, “A benchmark and simulator for UAV tracking,” in Proc. ECCV, 2016, pp. 445-461.
M. Kristan, A. Leonardis, J. Matas, M. Felsberg, R. Pflugfelder, and et al., “The sixth visual object tracking VOT2018 challenge results,” in Proc. ECCVW, 2018, pp. 3-53.
H. Fan, L. Lin, F. Yang, P. Chu, G. Deng, S. Yu, H. Bai, Y. Xu, C. Liao, and H. Ling, “LaSOT: A high-quality benchmark for large-scale single object tracking,”. IEEE CVPR, 2019.
A. Krizhevsky, I. Sutskever, and G. E. Hinton, “ImageNet classification with deep convolutional neural networks,” in Proc. NIPS, vol. 2, 2012, pp. 1097-1105.
K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proc. IEEE CVPR, 2016, pp. 770-778.
B. Li, J. Yan, W. Wu, Z. Zhu, and X. Hu, “High performance visual tracking with Siamese region proposal network,” in Proc. IEEE CVPR, 2018, pp. 8971–8980.
Z. Zhu, Q. Wang, B. Li, W. Wu, J. Yan, and W. Hu, “Distractor-aware Siamese networks for visual object tracking,” in Proc. ECCV, vol. 11213 LNCS, 2018, pp. 103-119.
B. Li, W. Wu, Q. Wang, F. Zhang, J. Xing, and J. Yan, “SiamRPN++: Evolution of Siamese visual tracking with very deep networks,”. IEEE CVPR, 2019.
Z. Zhang and H. Peng, “Deeper and wider Siamese networks for real-time visual tracking,”. IEEE CVPR, 2019.
Y. Yu, Y. Xiong, W. Huang, and M. R. Scott, “Deformable siamese attention networks for visual object tracking,” in Proc. IEEE CVPR, 2020.
Z. Chen, B. Zhong, G. Li, S. Zhang, and R. Ji, “Siamese box adaptive network for visual tracking,” in Proc. IEEE CVPR, 2020.
D. Guo, J. Wang, Y. Cui, Z. Wang, and S. Chen, “SiamCAR: Siamese fully convolutional classification and regression for visual tracking,” in Proc. IEEE CVPR, 2020.
P. Voigtlaender, J. Luiten, P. H. Torr, and B. Leibe, “SiamRCNN: Visual tracking by re-detection,” in Proc. IEEE CVPR, 2020.
