CFP last date
20 September 2024
Reseach Article

Review on Detection of Deepfake in Images and Videos

by Yaramasa Gautham, Sindhu R., Jenitta J.
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 186 - Number 29
Year of Publication: 2024
Authors: Yaramasa Gautham, Sindhu R., Jenitta J.
10.5120/ijca2024923825

Yaramasa Gautham, Sindhu R., Jenitta J. . Review on Detection of Deepfake in Images and Videos. International Journal of Computer Applications. 186, 29 ( Jul 2024), 51-60. DOI=10.5120/ijca2024923825

@article{ 10.5120/ijca2024923825,
author = { Yaramasa Gautham, Sindhu R., Jenitta J. },
title = { Review on Detection of Deepfake in Images and Videos },
journal = { International Journal of Computer Applications },
issue_date = { Jul 2024 },
volume = { 186 },
number = { 29 },
month = { Jul },
year = { 2024 },
issn = { 0975-8887 },
pages = { 51-60 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume186/number29/review-on-detection-of-deepfake-in-images-and-videos/ },
doi = { 10.5120/ijca2024923825 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-07-26T23:00:28.767064+05:30
%A Yaramasa Gautham
%A Sindhu R.
%A Jenitta J.
%T Review on Detection of Deepfake in Images and Videos
%J International Journal of Computer Applications
%@ 0975-8887
%V 186
%N 29
%P 51-60
%D 2024
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Deepfake technology can manipulate and superimpose existing images or videos onto other images or videos, creating realistic-looking but fabricated content. This technology has raised concerns as it can be used to create deceptive or misleading media, potentially causing harm by spreading false information or manipulating public perception. A detailed review is done on the detection of Deepfake in images and videos and it is presented in this paper. Various methods with which the detection of deepfake can be performed are image-based, video-based, frequency-based, Machine learning algorithm-based and Generative Adversarial-based methods. Various databases used, advantages and drawbacks of each literature are discussed in detail. After thorough research, it was found that the Attentive-pooling methods are giving better results than all the other methods that were proposed in the literature.

References
  1. Prasannavenkatesan Theerthagiri, Ghouse basha Nagaladinne, “Deepfake Face Detection Using Deep InceptionNet Learning Algorithm”, 2023 IEEE International Students' Conference on Electrical, Electronics and Computer Science, Feb 2023.
  2. David Guera, Edward J. Delp, “Deepfake Video Detection Using Recurrent Neural Networks”, 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Feb 2019.
  3. Vedant Jolly, Mayur Telrandhe, Aditya Kasat, Atharva Shitole, Kiran Gawande, “CNN based Deep Learning model for Deepfake Detection”, 2nd Asian Conference on Innovation in Technology (ASIANCON), pp.1-5, Aug 2022.
  4. Yonghyun Jeong, Doyeon Kim, Youngmin Ro, Jongwon Choi, “FrePGAN: Robust Deepfake Detection Using Frequency-level Perturbations”, Association for the Advancement of Artificial Intelligence, pp. 1060-1068, Feb 2022.
  5. Md. Shohel Rana; Beddhu Murali; Andrew H. Sung, “Deepfake Detection Using Machine Learning Algorithms”, 10th International Congress on Advanced Applied Informatics (IIAI-AAI), pp. 458-473, July 2021.
  6. Binh M. Le, Simon S. Woo, “Quality-Agnostic Deepfake Detection with Intra-model Collaborative Learning”, Sep 2023.
  7. Aminollah Khormali, Jiann-Shiun Yuan, “Self-Supervised Graph Transformer for Deepfake Detection”, pp.1-13, Jul 2023.
  8. Rahul Katarya, Anushka Lal, “A Study on Combating Emerging Threat of Deepfake Weaponization”, Fourth International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC), pp. 485-490, Oct 2020.
  9. Delmas, M., Kacete, A., Paquelet, S., Leglaive, S. and Seguier, R., “LatentForensics: Towards lighter deepfake detection in the StyleGAN latent space,” arXiv preprint arXiv:2303.17222, 2023.
  10. Lalitha S, Kavitha Sooda, “DeepFake Detection Through Key Video Frame Extraction using GAN”, International Conference on Automation, Computing and Renewable Systems (ICACRS 2022), pp. 859-863, Dec 2022.
  11. Young-Jin Heo, Young-Ju Choi, Young-Woon Lee, Byung-Gyu Kim, “Deepfake Detection Scheme Based on Vision Transformer and Distillation”, Applied Intelligence, Apr 2021.
  12. Davide Coccomini, Nicola Messina, Claudio Gennaro, Fabrizio Falchi, “Combining EfficientNet and Vision Transformers for Video Deepfake Detection”, Image Analysis and Processing, Springer – Lecture Notes Series, volume 2, pp.1-11, Jan 2022.
  13. Deressa Wodajo, Solomon Atnafu, Zahid Akhtar, “Deepfake Video Detection Using Generative Convolutional Vision Transformer”, arXiv:2307.07036, Volume 1, pp.(1-11), Jul 2023.
  14. Chaofei Yang, Leah Ding, Yiran Chen, Hai Li, “Defending against GAN-based DeepFake Attacks via Transformation-aware Adversarial Faces”, 2021 International Joint Conference on Neural Networks (IJCNN), July 2021.
  15. Preeti, Manoj Kumar, Hitesh Kumar Sharma, “A GAN-Based Model of Deepfake Detection in Social Media”, International Conference on Machine Learning and Data Engineering, Volume 218, pp. 2153-2162,2023.
  16. Young Oh Banga, Simon S. Woob, “DA-FDFtNet: Dual Attention Fake Detection Fine-tuning Network to Detect Various AI-Generated Fake Images”, arXiv:2112.12001v1 [cs.CV], pp.1-9, Dec 2021.
  17. Pratikkumar Prajapati, Chris Pollett, “MRI-GAN: A Generalized Approach to Detect DeepFakes using Perceptual Image Assessment”, ArXiv abs/2203.00108, Feb 2022.
  18. Sai Ashrith Aduwala, Manish Arigala, Shivan Desai, Heng Jerry Quan, Magdalini Eirinaki, “Deepfake Detection using GAN Discriminators”, 2021 IEEE Seventh International Conference on Big Data Computing Service and Applications (BigDataService), pp.69-77, Aug 2021.
  19. Mahsa Soleimani, Ali Nazari, Mohsen Ebrahimi Moghaddam, “Deepfake Detection of Occluded Images Using a Patch-based Approach”, arXiv:2304.04537Apr 2023.
  20. Luca Guarnera, Oliver Giudice, Sebastiano Battiato, “DeepFake Detection by Analyzing Convolutional Traces”, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp.2841-2850, 2020.
  21. Pallabi Saikia, Dhwani Dholaria, Priyanka Yadav, Vaidehi Patel, Mohendra Roy, “A Hybrid CNN-LSTM model for Video Deepfake Detection by Leveraging Optical Flow Features”, 2022 IEEE World Congress on Computational Intelligence, Jul 2022.
  22. Mohammed Akram Younus, Taha Mohammed Hasan, “Effective and Fast DeepFake Detection Method Based on Haar Wavelet Transform”, 2020 International Conference on Computer Science and Software Engineering (CSASE), pp.186-190, 16-18 April 2020.
  23. Atmik Ajoy, Chethan U Mahindrakar, Dhanya Gowrish, Vinay A, “DeepFake Detection using a frame based approach involving CNN”, 3rd International Conference on Inventive Research in Computing Applications (ICIRCA-2021), pp. 1329-1333, Sep 2021.
  24. ChangtaoMiao, QiChu,ZhentaoTan, ZhenchaoJin, WanyiZhuang, YueWu,BinLiu, HonggangHu, NenghaiYu, “Multi-spectral Class Center Network for FaceManipulation detection and localization”, arXiv:2305.10794 , Version 2, pp.1-16, Sep 2023.
  25. F. Xue, Q. Wang, Z. Tan, Z. Ma and G. Guo, "Vision Transformer With Attentive Pooling for Robust Facial Expression Recognition," in IEEE Transactions on Affective Computing, vol. 14, no. 4, pp. 3244-3256, 1 Oct.-Dec. 2023, doi: 10.1109/TAFFC.2022.3226473.
Index Terms

Computer Science
Information Sciences

Keywords

Attentive pooling Deep-fake Deep Learning Generative Adversarial Network Machine Learning