The week's pick
Reseach Article
Facial and Body features based Multi-Model Person Re-Identification: MPRe-ID
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 186 - Number 28 |
| Year of Publication: 2024 |
| Authors: Nikhil Kumar Singh, Manish Khare, Hemani Bharadwaj, Harikrishna B. Jethva |
10.5120/ijca2024923769
|
Nikhil Kumar Singh, Manish Khare, Hemani Bharadwaj, Harikrishna B. Jethva . Facial and Body features based Multi-Model Person Re-Identification: MPRe-ID. International Journal of Computer Applications. 186, 28 ( Jul 2024), 21-29. DOI=10.5120/ijca2024923769
Abstract
Within the surveillance area, Person Re-identification (Re-ID) holds considerable importance by enabling the matching of a person's appearance across multiple non-overlapping cameras. Nonetheless, this task poses challenges due to factors like changes in camera viewpoints, occlusion, and variations in appearance, including clothing, shoes, and pose. Overcoming these challenges requires discriminative feature learning. Deep convolutional neural networks (CNNs) have recently gained widespread usage to address this objective. This study introduces a lightweight and robust deep learning framework Multi-Model person Re-ID (MPRe-ID) for person re-identification. It incorporates the YOLOv4 object detection model for pedestrian detection and utilizes SORT with deep metric association (DeepSORT) algorithm for tracking. MPRe-ID uses novel body feature extraction model to learn discriminative features at various semantic levels, leveraging the ResNeXt architecture as its backbone. The proposed body feature extraction model contains multiple blocks where channels are concatenated between blocks, and an aggregation gate is employed to aggregate the output of multiple channels. The aggregation gate produces channel-wise weights dynamically, facilitating the fusion of resulting multi-scale feature maps. This layout effectively enables the model to extract discriminative features even in challenging conditions. To evaluate the efficacy of our proposed MPRe-ID framework including body and Face features, we conducted experiments on the widely-used Market1501 and DukeMTMC-reID dataset. The experimental results compared with state-of-the-art approaches demonstrate the effectiveness of our MPRe-ID approach.
References
- Singh, Nikhil Kumar, Manish Khare, and Harikrishna B. Jethva. "A comprehensive survey on person re-identification approaches: various aspects." Multimedia Tools and Applications 81, no. 11 (2022): 15747-15791.
- Mukherjee Arnab, “YOLO: Algorithm for Object Detection Explained,” LinkediIn, 2023. Available: https://www.linkedin.com/pulse/yolo-algorithm-object-detection-explained-arnab-mukherjee/
- N. Wojke, A. Bewley, and D. Paulus, “Simple online and real-time tracking with a deep association metric,” in Proceedings - International Conference on Image Processing, ICIP, 2017, vol. 2017-September, doi: 10.1109/ICIP.2017.8296962.
- Y. C. Chen, W. S. Zheng, J.-H. Lai, and P. C. Yuen. An asymmetric distance model for cross-view feature mapping in person re-identification. IEEE transactions on circuits and systems for video technology, 27(8):1661–1675, 2016.
- R. De Maesschalck, D. Jouan-Rimbaud, and D. L. Massart. The mahalanobis distance. Chemometrics and intelligent laboratory systems, 50(1):1–18, 2000.
- Q. Meibin, W. Yunxia, T. Shengshun, et. al. Person re-identification based on regularization of independent measure matrix. Pattern Recognition and Artificial Intelligence, 29(6):511–518, 2016.
- L. An, X. Chen, and S. Yang. Person re-identification via hypergraph-based matching. Neuro computing, 182:247–254, 2016.
- X. Zhao, N. Wang, Y. Zhang, S. Du, Y. Gao, and J. Sun. Beyond pairwise matching: Person reidentification via high-order relevance learning. IEEE transactions on neural networks and learning systems, 29(8):3701–3714, 2017.
- N. Pu, W. Chen, Y. Liu, E. M. Bakker, and M. S. Lew. Lifelong person reidentification via adaptive knowledge accumulation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 7901– 7910, 2021.
- S. Xuan and S. Zhang. Intra-inter camera similarity for unsupervised person re-identification. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 11926–11935, 2021.
- K. Zheng, W. Liu, L. He, T. Mei, J. Luo, and Z. J. Zha. Group-aware label transfer for domain adaptive person re-identification. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5310–5319, 2021.
- M. Ye, J. Shen, G. Lin, T. Xiang, L. Shao, and S. C. Hoi. Deep learning for person re-identification: A survey and outlook. IEEE transactions on pattern analysis and machine intelligence, 44(6):2872–2893, 2021.
- Z. Ming, M. Zhu, X. Wang, J. Zhu, J. Cheng, C. Gao, Y. Yang, and X. Wei. Deep learning-based person re-identification methods: A survey and outlook of recent works. Image and Vision Computing, 119:104394, 2022.
- Z. Zheng, L. Zheng, and Y. Yang. A discriminatively learned CNN embedding for person re-identification. ACM transactions on multimedia computing, communications, and applications (TOMM), 14(1):1–20, 2017.
- A. Hermans, L. Beyer, and B. Leibe. In defense of the triplet loss for person re-identification. arXiv preprint arXiv:1703.07737, 2017.
- K. Zhou, Y. Yang, A. Cavallaro, and T. Xiang. Omni-scale feature learning for person re-identification. In Proceedings of the IEEE/CVF international conference on computer vision, pages 3702–3712, 2019.
- L. Zheng, L. Shen, L. Tian, S. Wang, J. Wang, and Q. Tian. Scalable person reidentification: A benchmark. In Proceedings of the IEEE international conference on computer vision, pages 1116–1124, 2015.
- E. Ristani, F. Solera, R. Zou, R. Cucchiara, and C. Tomasi. Performance measures and a data set for multi-target, multi-camera tracking. In Computer Vision–ECCV 2016 Workshops: Amsterdam, The Netherlands, October 8-10 and 15-16, 2016, Proceedings, Part II, pages 17–35. Springer, 2016.
- G. Pant, D. Yadav, and A. Gaur. Resnext convolution neural network topologybased deep learning model for identification and classification of pediastrum. Algal research, 48:101932, 2020.
- V. Yathish, “Loss Functions and Their Use In Neural Networks,” Towards Data Science, Aug. 04, 2022. https://towardsdatascience.com/loss-functions-and-their-use-in-neural-networks-a470e703f1e9 (accessed Apr. 12, 2023).
- K. Mahendru, “Understanding Loss Functions to Maximize Machine Learning Model Performance (Updated 2023),” Aug. 14, 2019. https://www.analyticsvidhya.com/blog/2019/08/detailed-guide-7-loss-functions-machine-learning-python-code/ (accessed May 25, 2023).
- A. Hermans, L. Beyer, and B. Leibe, “In Defense of the Triplet Loss for Person Re-Identification,” 2017, [Online]. Available: http://arxiv.org/abs/1703.07737.
- K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. cvpr. 2016. arXiv preprint arXiv:1512.03385, 2016.
- F. Chollet. Xception: Deep learning with depthwise separable convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1251–1258, 2017.
- Zhou, Yalei, Peng Liu, Yue Cui, Chunguang Liu, and Wenli Duan. "Integration of multi-head self-attention and convolution for person re-identification." Sensors 22, no. 16 (2022): 6293.
- F. Schroff, D. Kalenichenko, and J. Philbin. Facenet: A unified embedding for face recognition and clustering. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 815–823, 2015.
- J. Xiang and G. Zhu. Joint face detection and facial expression recognition with mtcnn. In 2017 4th international conference on information science and control engineering (ICISCE), pages 424–427. IEEE, 2017.
- Li, Dangwei, Chen, X., Zhang, Z. and Huang, K., Learning deep context-aware features over body and latent parts for person re-identification. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 384-393), 2017.
Index Terms
Keywords