The week's pick
Reseach Article
Study on Deepfake Face Detection using Transfer Learning Approach
| International Journal of Computer Applications |
| Foundation of Computer Science (FCS), NY, USA |
| Volume 186 - Number 37 |
| Year of Publication: 2024 |
| Authors: Jannatul Mawa, Md. Humayun Kabir |
10.5120/ijca2024923948
|
Jannatul Mawa, Md. Humayun Kabir . Study on Deepfake Face Detection using Transfer Learning Approach. International Journal of Computer Applications. 186, 37 ( Aug 2024), 44-48. DOI=10.5120/ijca2024923948
Abstract
The emergence of deepfake technology has added a new dimension to digital media manipulation. The increasing prevalence of these manipulated visual contents poses significant threats to the authenticity and trustworthiness of digital media. In response to this growing threat, this research work investigates into an approach for detecting deepfake face images through the fusion of transfer learning and deep ensemble neural network techniques. This methodology adopts transfer learning and ensemble neural network techniques to improve the accuracy of detection and generalization capabilities of deepfake detection models. The research includes an extensive evaluation of the deep ensemble neural network on available challenging deepfake datasets. The effectiveness of the applied strategy is evaluated against currently existing techniques using performance indicators such as accuracy, precision, recall, and F1-scores. Finally, this paper presents a notable contribution to the area of deepfake detection through the development of a transfer learning-based deep ensemble neural network.
References
- Khichi, M., and Yadav, R. K. (2021, December). Analyzing the methods for detecting deepfakes. In 2021 3rd International Conference on Advances in Computing, Communication Control and Networking (ICAC3N) (pp. 340-345). IEEE.
- A.Raza, K.Munir, and M.Almutairi, “A novel deep learning approach for deepfake image detection,” Applied Sciences, vol. 12, no. 19, p. 9820, 2022.
- Y. Abdalla, M. Iqbal, and M. Shehata, “Image forgery detection based on deep transfer learning,” European Journal of Electrical Engineering and Computer Science, vol. 3, no. 5, 2019.
- N. Kumar, P. Pranav, V. Nirney, and V. Geetha, “Deepfake image detection using cnns and transfer learning,” in 2021 International Conference on Computing, Communication and Green Engineering (CCGE). IEEE, 2021, pp. 1–6.
- X. Chang, J. Wu, T. Yang, and G. Feng, “Deepfake face image detection based on improved vgg convolutional neural network,” in 2020 39th chinese control conference (CCC). IEEE, 2020, pp. 7252–7256.
- Patrick Schneider, and Fatos Xhafa, in Anomaly Detection and Complex Event Processing over IoT Data Streams, 2022
- Qureshi, A.S., and Roos, T. (2021). Transfer Learning with Ensembles of Deep Neural Networks for Skin Cancer Detection in Imbalanced Data Sets. Neural Processing Letters, 55, 4461 - 4479.
- Vallabhajosyula, S., Sistla, V., Kolli, and V.K. (2021). Transfer learning-based deep ensemble neural network for plant leaf disease detection. Journal of Plant Diseases and Protection, 129,545 - 558.
- Sharma, J., Sharma, S., Kumar, V., Hussein, H.S., and Alshazly, H.A. (2022). Deepfakes Classification of Faces Using Convolutional Neural Networks. Traitement du Signal.
- Shad, H.S., Rizvee, M.M., Roza, N.T., Hoq, S.M., Khan, M.M., Singh, A., Zaguia, A., and Bourouis, S. (2021). Comparative Analysis of Deepfake Image Detection Method Using Convolutional Neural Network. Computational Intelligence and Neuroscience, 2021.
- Rana, M.S., Nobi, M.N., Murali, B., Sung, and A.H. (2022). Deepfake Detection: A Systematic Literature Review. IEEE Access, 10, 25494-25513.
- Deep Learning Approaches for Early Diagnosis of Neurodegenerative Diseases.DOI:10.4018/979-8-3693-1281-0.ch011
- https://www.ibm.com/topics/deep-learning
- Pan, S. J., and Yang, Q. (2009). A survey on transfer learning. IEEE Transactions on knowledge and data engineering, 22(10), 1345-1359.
- He, K., Zhang, X., Ren, S., and Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770-778).
- Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K. Q. (2017). Densely connected convolutional networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 4700-4708).
- Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016). Rethinking the inception architecture for computer vision. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2818-2826).
- https://towardsdatascience.com/ensemble-methods-bagging-boosting-and-stacking-c9214a10a205
- Mohammed, A., and Kora, R. (2023). A comprehensive review on ensemble deep learning: Opportunities and challenges. Journal of King Saud University-Computer and Information Sciences, 35(2), 757-774.
- Available: https://www.kaggle.com/datasets/ciplab/real-and-fake-face-detection
- Deng, J., Dong, W., Socher, R., Li, L. J., Li, K., and Fei-Fei, L. (2009, June). Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition (pp. 248-255). Ieee.
- Suratkar, S., Kazi, F., Sakhalkar, M., Abhyankar, N., and Kshirsagar, M. (2020, December). Exposing deepfakes using convolutional neural networks and transfer learning approaches. In 2020 IEEE 17th India council international conference (INDICON) (pp. 1-8). IEEE.
- Suratkar, S., Johnson, E., Variyambat, K., Panchal, M., and Kazi, F. (2020, July). Employing transfer-learning based CNN architectures to enhance the generalizability of deepfake detection. In 2020 11th international conference on computing, communication and networking technologies (ICCCNT) (pp. 1-9). IEEE.
- Patel, M., Gupta, A., Tanwar, S., and Obaidat, M. S. (2020, October). Trans-DF: a transfer learning-based end-to-end deepfake detector. In 2020 IEEE 5th international conference on computing communication and automation (ICCCA) (pp. 796-801). IEEE.
- Mahmud, F., Abdullah, Y., Islam, M., and Aziz, T. (2023, December). Unmasking Deepfake Faces from Videos Using An Explainable Cost-Sensitive Deep Learning Approach. In 2023 26th International Conference on Computer and Information Technology (ICCIT) (pp. 1-6). IEEE.
- Coccomini, D. A., Messina, N., Gennaro, C., and Falchi, F. (2022, May). Combining efficientnet and vision transformers for video deepfake detection. In International conference on image analysis and processing (pp. 219-229). Cham: Springer International Publishing.
- Gong, D., Kumar, Y. J., Goh, O. S., Ye, Z., and Chi, W. (2021). DeepfakeNet, an efficient deepfake detection method. International Journal of Advanced Computer Science and Applications, 12(6), 201-207.
- Atwan, J., Wedyan, M., Albashish, D., Aljaafrah, E., Alturki, R., and Alshawi, B. (2024). Using Deep Learning to Recognize Fake Faces. International Journal of Advanced Computer Science & Applications, 15(1).
Index Terms
Keywords