Skip to content

Latest commit

 

History

History
567 lines (438 loc) · 71.5 KB

README.md

File metadata and controls

567 lines (438 loc) · 71.5 KB

Awesome Deepfakes DetectionAwesome

from internet (image from internet)

A collection list of Deepfakes Detection related datasets, tools, papers, and code. If this list helps you on your research, a star will be my pleasure :)

If you want to contribute to this list, welcome to send me a pull request or contact me :)

This repository only collects papers related to Deepfake Detection. If you are also interested in Deepfakes generation, please refer to: Awesome Deepfakes.

Contents

Datasets

Video Datasets

  • UADFV: Exposing Deep Fakes Using Inconsistent Head Poses. Paper
  • EBV: In Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinking. Paper Download
  • Deepfake-TIMIT: DeepFakes: a New Threat to Face Recognition? Assessment and Detection. Paper Download
  • DFFD: On the Detection of Digital Face Manipulation. Paper Download
  • DeepfakeDetection: Download
  • Celeb-DF (v1): Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensics. Paper Download
  • Celeb-DF (v2): Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensics. Paper Download
  • DFDC: The DeepFake Detection Challenge (DFDC) Dataset. Paper Download
  • FaceForensic++: FaceForensics++: Learning to Detect Manipulated Facial Images. Paper Download
  • FFIW-10K: Face Forensics in the Wild. Paper Download
  • Deeper Forensic-1.0: DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detection. Paper Download
  • Wild Deepfake: WildDeepfake: A Challenging Real-World Dataset for Deepfake Detection. Paper Download
  • ForgeryNet: ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysis. Paper Download
  • WLDR: Protecting World Leaders Against Deep Fakes. Paper
  • FakeAVCeleb: FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Dataset. Paper Download
  • DeepSpeak: DeepSpeak Dataset v1.0. Paper Download
Real Videos Fake Videos Year Note
UADFV 49 49 2018 focus on head pose
EBV - 49 2018 focus on eye blinking
Deepfake-TIMIT 320 640 2018 GAN-Based methods
DFFD 1,000 3000 2019 mutiple SOTA methods
DeepfakeDetection 363 3,068 2019 collect from actors with publicly available generation methods
Celeb-DF (v2) 590 5639 2019 high quality
DFDC 23,564 104,500 2019 DFDC competition on Kaggle
FaceForensic++ 1,000 5,000 2019 five different generation methods
FFIW-10K 10,000 10,000 2019 mutiple faces in one frame
WLDR - - 2019 person of interest video from Youtube
DeeperForensics-1.0 50,000 10,000 2020 add real-world perturbations
Wild-Deepfake 3,805 3,509 2021 collect from Internet
ForgeryNet 99,630 121,617 2021 8 video-level generation methods, add perturbations
FakeAVCeleb 500 19,500 2021 audio-visual multi-modalies dataset
DeepSpeak 6,226 5,958 2024 lip-sync and face-swap deepfakes with audio manipulated

Image Datasets

  • DFFD: On the Detection of Digital Face Manipulation. Paper Download
  • iFakeFaceDB: GANprintR: Improved Fakes and Evaluation of the State of the Art in Face Manipulation Detection. Paper Download
  • 100k Faces Generated by AI (Online): Download
  • DFGC: DFGC 2021: A DeepFake Game Competition. Paper Dowload
  • ForgeryNet: ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysis. Paper Download
Real Images Fake Images Year Note
DFFD 58,703 240,336 2019 mutiple SOTA methods
iFakeFaceDB - 87,000 (StyleGAN) 2020 generated by StyleGAN
100k Faces - 100,000 (StyleGAN) 2021 generated by StyleGAN
DFGC 1,000 N*1,000 2021 DFGC 2021 competition, fake images generated by users
ForgeryNet 1,438,201 1,457,861 2021 7 image-level generation methods, add perturbations

Competitions

Name Link Year Note
Deepfake Detection Challenge Website 2019 1. video-level detection.
2. use DFDC datasets.
3. the first worldwide competition.
4. more than 2,000 teams participated.
DeepForensics Challenge Website 2020 1. video-level detection.
2. use DeeperForensics-1.0 datasets.
3. simulates real-world scenarios.
Deepfake Game Competition Website 2021 1. both image-level generation and video-level detection track.
2. use Celeb-DF(v2) datasets.
Face Forgery Analysis Challenge Website 2021 1. both image-level and video-level detection track.
2. addtional temporal localization track.
3. use ForgeryNet dataset.

Tools

Recent Conference Papers

CVPR

  • Exploiting Style Latent Flows for Generalizing Video Deepfake Detection, CVPR 2024: Paper
  • AVFF: Audio-Visual Feature Fusion for Video Deepfake Detection, CVPR 2024: Paper
  • Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detection, CVPR 2024: Paper
  • Rethinking the Up-Sampling Operations in CNN-based Generative Network for Generalizable Deepfake Detection, CVPR 2024: Paper Github
  • LAA-Net: Localized Artifact Attention Network for Quality-Agnostic and Generalizable Deepfake Detection, CVPR 2024: Paper Github
  • Preserving Fairness Generalization in Deepfake Detection, CVPR 2024: Paper Github
  • Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalization, CVPR 2023: Paper Github
  • Implicit Identity Driven Deepfake Face Swapping Detection, CVPR 2023: Paper
  • AltFreezing for More General Face Forgery Detection, CVPR 2023: Paper
  • AUNet: Learning Relations Between Action Units for Face Forgery Detection, CVPR 2023: Paper
  • Dynamic Graph Learning with Content-guided Spatial-Frequency Relation Reasoning for Deepfake Detection, CVPR 2023: Paper
  • TruFor: Leveraging all-round clues for trustworthy image forgery detection and localization, CVPR 2023: Paper Github
  • Learning on Gradients: Generalized Artifacts Representation for GAN-Generated Images Detection, CVPR 2023: Paper Github
  • Towards Universal Fake Image Detectors That Generalize Across Generative Models, CVPR 2023: Paper Github
  • DF-Platter: Multi-Face Heterogeneous Deepfake Dataset, CVPR 2023: Paper
  • Self-Supervised Video Forensics by Audio-Visual Anomaly Detection, CVPR 2023: Paper Github
  • Fake it till you make it: Learning transferable representations from synthetic ImageNet clones, CVPR 2023: Paper Pretrained
  • Evading DeepFake Detectors via Adversarial Statistical Consistency, CVPR 2023: Paper
  • Evading Forensic Classifiers with Attribute-Conditioned Adversarial Faces, CVPR 2023: Paper Github
  • Detecting and Grounding Multi-Modal Media Manipulation, CVPR 2023: Paper Github
  • Hierarchical Fine-Grained Image Forgery Detection and Localization, CVPR 2023: Paper Github
  • Instance-Aware Domain Generalization for Face Anti-Spoofing, CVPR 2023: Paper Github
  • Rethinking Domain Generalization for Face Anti-spoofing: Separability and Alignment, CVPR 2023: Paper Github
  • Learning Second Order Local Anomaly for General Face Forgery Detection, CVPR 2022: Paper
  • DeepFake Disrupter: The Detector of DeepFake Is My Friend, CVPR 2022: Paper
  • Protecting Celebrities from DeepFake with Identity Consistency Transformer, CVPR 2022: Paper Github
  • Detecting Deepfakes with Self-Blended Images, CVPR 2022: Paper Github
  • Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detection, CVPR 2022: Paper Github
  • End-to-End Reconstruction-Classification Learning for Face Forgery Detection, CVPR 2022: Paper
  • Robust Image Forgery Detection Against Transmission Over Online Social Networks, CVPR 2022: Paper Github
  • Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection, CVPR 2022: Paper
  • Exploring Frequency Adversarial Attacks for Face Forgery Detection, CVPR 2022: Paper
  • ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysis, CVPR 2021: Paper Github
  • Representative Forgery Mining for Fake Face Detection, CVPR 2021: Paper Github
  • MagDR: Mask-Guided Detection and Reconstruction for Defending Deepfakes, CVPR 2021: Paper
  • Improving the Efficiency and Robustness of Deepfakes Detection Through Precise Geometric Features, CVPR 2021: Paper Github
  • Multi-Attentional Deepfake Detection, CVPR 2021: Paper Github
  • Lips Don't Lie: A Generalisable and Robust Approach To Face Forgery Detection, CVPR 2021: Paper
  • Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domain, CVPR 2021: Paper
  • Frequency-Aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detection, CVPR 2021: Paper
  • Generalizing Face Forgery Detection With High-Frequency Features, CVPR 2021: Paper
  • Face Forgery Detection by 3D Decomposition, CVPR 2021: Paper
  • Global Texture Enhancement for Fake Face Detection in the Wild, CVPR 2020: Paper
  • On the Detection of Digital Face Manipulation, CVPR 2020: Paper Github
  • Face X-Ray for More General Face Forgery Detection, CVPR 2020: Paper
  • CNN-generated images are surprisingly easy to spot... for now, CVPR 2020: Paper Github
  • Lost in Translation: Lip-Sync Deepfake Detection from Audio-Video Mismatch, CVPR Workshop 2024: Paper
  • CORE: Consistent Representation Learning for Face Forgery Detection, CVPR Workshop 2022: Paper Github
  • FReTAL: Generalizing Deepfake Detection using Knowledge Distillation and Representation Learning, CVPR Workshop 2021: Paper
  • Towards Untrusted Social Video Verification to Combat Deepfakes via Face Geometry Consistency, CVPR Workshop 2020: Paper
  • OC-FakeDect: Classifying Deepfakes Using One-class Variational Autoencoder, CVPR Workshop 2020: Paper
  • Exposing DeepFake Videos By Detecting Face Warping Artifacts, CVPR Workshop 2019: Paper
  • Recurrent Convolutional Strategies for Face Manipulation Detection in Videos, CVPR Workshop 2019: Paper
  • Two-Stream Neural Networks for Tampered Face Detection, CVPR Workshop 2017: Paper

ICCV

  • Towards Understanding the Generalization of Deepfake Detectors from a Game-Theoretical View, ICCV 2023: Paper
  • Controllable Guide-Space for Generalizable Face Forgery Detection, ICCV 2023: Paper
  • TALL: Thumbnail Layout for Deepfake Video Detection, ICCV 2023: Paper Github
  • Quality-Agnostic Deepfake Detection with Intra-model Collaborative Learning, ICCV 2023: Paper
  • UCF: Uncovering Common Features for Generalizable Deepfake Detection, ICCV 2023: Paper
  • Contrastive Pseudo Learning for Open-World DeepFake Attribution, ICCV 2023: Paper
  • ID-Reveal: Identity-aware DeepFake Video Detection, ICCV 2021: Paper Github
  • Learning Self-Consistency for Deepfake Detection, ICCV 2021: Paper
  • Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Data, ICCV 2021: Paper Github
  • KoDF: A Large-scale Korean DeepFake Detection Dataset, ICCV 2021: Paper
  • Exploring Temporal Coherence for More General Video Face Forgery Detection, ICCV 2021: Paper Github
  • Joint Audio-Visual Deepfake Detection, ICCV 2021: Paper
  • OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wild, ICCV 2021: Paper
  • Attributing Fake Images to GANs: Learning and Analyzing GAN Fingerprints, ICCV 2019: Paper Github
  • DeepFake MNIST+: A DeepFake Facial Animation Dataset, ICCV Workshop 2021: Paper

ECCV

  • Learning Natural Consistency Representation for Face Forgery Video Detection, ECCV 2024: Paper
  • Contrasting Deepfakes Diffusion via Contrastive Learning and Global-Local Similarities, ECCV 2024: Paper
  • Common Sense Reasoning for Deep Fake Detection, ECCV 2024: Paper
  • Real Appearance Modeling for More General Deepfake Detection, ECCV 2024: Paper
  • Fake It till You Make It: Curricular Dynamic Forgery Augmentations towards General Deepfake Detection, ECCV 2024: Paper
  • Detecting and Recovering Sequential DeepFake Manipulation, ECCV 2022: Paper Github
  • Hierarchical Contrastive Inconsistency Learning for Deepfake Video Detection, ECCV 2022: Paper
  • Explaining Deepfake Detection by Analysing Image Matching, ECCV 2022: Paper
  • FingerprintNet: Synthesized Fingerprints for Generated Image Detection, ECCV 2022: Paper
  • UIA-ViT: Unsupervised Inconsistency-Aware Method based on Vision Transformer for Face Forgery Detection, ECCV 2022: Paper Github
  • Adaptive Face Forgery Detection in Cross Domain, ECCV 2022: Paper
  • An Information Theoretic Approach for Attention-Driven Face Forgery Detection, ECCV 2022: Paper
  • Exploring Disentangled Content Information for Face Forgery Detection, ECCV 2022: Paper
  • Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Clues, ECCV 2020: Paper
  • Two-branch Recurrent Network for Isolating Deepfakes in Videos, ECCV 2020: Paper

NeurIPS

  • DeepfakeBench: A Comprehensive Benchmark of Deepfake Detection, NeurIPS 2023: Paper Github

  • Delving into Sequential Patches for Deepfake Detection, NeurIPS 2022: Paper

  • OST: Improving Generalization of DeepFake Detection via One-Shot Test-Time Training, NeurIPS 2022: Paper Github

  • WaveFake: A Data Set to Facilitate Audio Deepfake Detection, NeurIPS 2021: Paper Github

  • AOT: Appearance Optimal Transport Based Identity Swapping for Forgery Detection, NeurIPS 2020: Paper

ICLR

  • Poisoned Forgery Face: Towards Backdoor Attacks on Face Forgery Detection, ICLR 2024: Paper Github
  • Responsible Disclosure of Generative Models Using Scalable Fingerprinting, ICLR 2022: Paper Github

ICML

  • DRCT: Diffusion Reconstruction Contrastive Training towards Universal Detection of Diffusion Generated Images, ICML 2024: Paper Github
  • How to Trace Latent Generative Model Generated Images without Artificial Watermark? ICML 2024: Paper
  • DistilDIRE: A Small, Fast, Cheap and Lightweight Diffusion Synthesized Deepfake Detection, ICML Workshop 2024: Paper Github
  • Leveraging Frequency Analysis for Deep Fake Image Recognition, ICML 2020: Paper Github

IJCAI

  • Region-Aware Temporal Inconsistency Learning for DeepFake Video Detection, IJCAI 2022: Paper
  • Anti-Forgery: Towards a Stealthy and Robust DeepFake Disruption Attack via Adversarial Perceptual-aware Perturbations, IJCAI 2022: Paper Github
  • Detecting Deepfake Videos with Temporal Dropout 3DCNN, IJCAI 2021: Paper
  • Dynamic Inconsistency-aware DeepFake Video Detection, IJCAI 2021: Paper
  • An Examination of Fairness of AI Models for Deepfake Detection, IJCAI 2021: Paper
  • Beyond the Spectrum: Detecting Deepfakes via Re-Synthesis, IJCAI 2021: Paper Github
  • FakeSpotter: A Simple yet Robust Baseline for Spotting AI-Synthesized Fake Faces, IJCAI 2020: Paper

AAAI

  • Deepfake Video Detection via Facial Action Dependencies Estimation, AAAI 2023: Paper
  • Noise Based Deepfake Detection via Multi-Head Relative-Interaction, AAAI 2023: Paper
  • Practical Disruption of Image Translation Deepfake Networks, AAAI 2023: Paper
  • Delving into the Local: Dynamic Inconsistency Learning for DeepFake Video Detection, AAAI 2022: Paper
  • Deepfake Network Architecture Attribution, AAAI 2022: Paper Github
  • Dual Contrastive Learning for General Face Forgery Detection, AAAI 2022: Paper
  • CMUA-Watermark: A Cross-Model Universal Adversarial Watermark for Combating Deepfakes, AAAI 2022: Paper Github
  • ADD: Frequency Attention and Multi-View based Knowledge Distillation to Detect Low-Quality Compressed Deepfake Images, AAAI 2022: Paper
  • Exploiting Fine-grained Face Forgery Clues via Progressive Enhancement Learning, AAAI 2022: Paper
  • FInfer: Frame Inference-based Deepfake Detection for High-Visual-Quality Videos, AAAI 2022: Paper
  • FrePGAN: Robust Deepfake Detection Using Frequency-level Perturbations, AAAI 2022: Paper
  • Domain General Face Forgery Detection by Learning to Weight, AAAI 2021: Paper Github
  • Local Relation Learning for Face Forgery Detection, AAAI 2021: Paper

MM

  • Wavelet-enhanced Weakly Supervised Local Feature Learning for Face Forgery Detection, ACM MM 2022: Paper

  • Defeating DeepFakes via Adversarial Visual Reconstruction, ACM MM 2022: Paper

  • Evaluation of an Audio-Video Multimodal Deepfake Dataset using Unimodal and Multimodal Detectors, ACM MM 2021: Paper

  • Spatiotemporal Inconsistency Learning for DeepFake Video Detection, ACM MM 2021: Paper

  • Video Transformer for Deepfake Detection with Incremental Learning, ACM MM 2021: Paper

  • Metric Learning for Anti-Compression Facial Forgery Detection, ACM MM 2021: Paper

  • CoReD: Generalizing Fake Media Detection with Continual Representation using Distillation, ACM MM 2021: Paper

  • FakeTagger: Robust Safeguards against DeepFake Dissemination via Provenance Tracking, ACM MM 2021: Paper

  • FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Dataset, ACM MM 2021 Workshop: Paper Github

  • Not made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localization, ACM MM 2020: Paper Github

  • Sharp Multiple Instance Learning for DeepFake Video Detection, ACM MM 2020: Paper

  • DeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythms, ACM MM 2020: Paper

  • Emotions Don't Lie: An Audio-Visual Deepfake Detection Method using Affective Cues, ACM MM 2020: Paper

Survey

  • Deepfake: Definitions, Performance Metrics and Standards, Datasets and Benchmarks, and a Meta-Review, arXiv 2022: Paper
  • Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forward, Applied Intelligence 2022: Paper
  • DeepFake Detection for Human Face Images and Videos: A Survey, IEEE Access 2022: Paper
  • Deepfake Detection: A Systematic Literature Review, IEEE Access 2022: Paper
  • A Survey on Deepfake Video Detection, Iet Biometrics 2021: Paper

Spatiotemporal Based

  • TALL: Thumbnail Layout for Deepfake Video Detection, ICCV 2023: Paper Github
  • Hierarchical Contrastive Inconsistency Learning for Deepfake Video Detection, ECCV 2022: Paper
  • Region-Aware Temporal Inconsistency Learning for DeepFake Video Detection, IJCAI 2022: Paper
  • FInfer: Frame Inference-based Deepfake Detection for High-Visual-Quality Videos, AAAI 2022: Paper
  • Delving into the Local: Dynamic Inconsistency Learning for DeepFake Video Detection, AAAI 2022: Paper
  • Deepfake video detection with spatiotemporal dropout transformer, ACM MM 2022: Paper
  • Exploring Complementarity of Global and Local Spatiotemporal Information for Fake Face Video Detection, ICASSP 2022: Paper
  • Face Forgery Detection Based on Facial Region Displacement Trajectory Series, arXiv 2022: Paper
  • Do You Really Mean That? Content Driven Audio-Visual Deepfake Dataset and Multimodal Method for Temporal Forgery Localization, arXiv 2022: Paper
  • Exploring Temporal Coherence for More General Video Face Forgery Detection, ICCV 2021: Paper
  • Detecting Deepfake Videos with Temporal Dropout 3DCNN, IJCAI 2021: Paper
  • Video Transformer for Deepfake Detection with Incremental Learning, ACM MM 2021: Paper
  • FSSPOTTER: Spotting Face-Swapped Video by Spatial and Temporal Clues, ICME 2020: Paper
  • Deepfake Video Detection Based on Spatial, Spectral, and Temporal Inconsistencies Using Multimodal Deep Learning, AIPR 2020: Paper

Frequency Based

  • FrePGAN: Robust Deepfake Detection Using Frequency-level Perturbations, AAAI 2022: Paper
  • Exploiting Fine-grained Face Forgery Clues via Progressive Enhancement Learning, AAAI 2022: Paper
  • Wavelet-enhanced Weakly Supervised Local Feature Learning for Face Forgery Detection, ACM MM 2022: Paper
  • Wavelet-Packets for Deepfake Image Analysis and Detection, Machine Learning 2022: Paper Github
  • Generalizing Face Forgery Detection with High-frequency Features, CVPR 2021: Paper
  • ADD: Frequency Attention and Multi-View based Knowledge Distillation to Detect Low-Quality Compressed Deepfake Images, AAAI 2021: Paper
  • Local Relation Learning for Face Forgery Detection, AAAI 2021: Paper
  • Fighting Deepfakes by Detecting GAN DCT Anomalies, Journal of Imaging 2021: Paper
  • MD-CSDNetwork: Multi-Domain Cross Stitched Network for Deepfake Detection, FG 2021: Paper
  • Using Grayscale Frequency Statistic to Detect Manipulated Faces in Wavelet-Domain, SMC 2021: Paper Github
  • Deepfake Video Detection Based on Spatial, Spectral, and Temporal Inconsistencies Using Multimodal Deep Learning, AIPR 2020: Paper
  • Effective and Fast DeepFake Detection Method Based on Haar Wavelet Transform, CSASE 2020: Paper

Generalization

  • Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detection, CVPR 2024: Paper
  • Rethinking the Up-Sampling Operations in CNN-based Generative Network for Generalizable Deepfake Detection, CVPR 2024: Paper Github
  • Exploiting Style Latent Flows for Generalizing Video Deepfake Detection, CVPR 2024: Paper
  • Controllable Guide-Space for Generalizable Face Forgery Detection, ICCV 2023: Paper
  • Towards Understanding the Generalization of Deepfake Detectors from a Game-Theoretical View, ICCV 2023: Paper
  • UCF: Uncovering Common Features for Generalizable Deepfake Detection, ICCV 2023: Paper
  • Rethinking Domain Generalization for Face Anti-spoofing: Separability and Alignment, CVPR 2023: Paper Github
  • Generalized Facial Manipulation Detection with Edge Region Feature Extraction, WACV 2022: Paper
  • Supervised Contrastive Learning for Generalizable and Explainable DeepFakes Detection, WACV 2022: Paper Github
  • Towards Generalizable Detection of Face Forgery via Self-Guided Model-Agnostic Learning, PRL 2022: Paper
  • Learning to mask: Towards generalized face forgery detection, arXiv 2022: Paper
  • FReTAL: Generalizing Deepfake Detection using Knowledge Distillation and Representation Learning, CVPR 2021: Paper
  • Detection of Fake and Fraudulent Faces via Neural Memory Networks, TIFS 2021: Paper
  • One detector to rule them all: Towards a general deepfake attack detection framework, Proceedings of the Web Conference 2021: Paper Github
  • Supervised Contrastive Learning for Generalizable and Explainable DeepFakes Detection, WACV 2021: Paper Github
  • Improving Generalization of Deepfake Detection with Domain Adaptive Batch Normalization, Proceedings of the 1st International Workshop on Adversarial Learning for Multimedia 2021: Paper
  • FeatureTransfer: Unsupervised Domain Adaptation for Cross-Domain Deepfake Detection, Security and Communication Networks 2021: Paper
  • Training Strategies and Data Augmentations in CNN-based DeepFake Video Detection, WIFS 2020: Paper
  • Improved Generalizability of Deep-Fakes Detection Using Transfer Learning Based CNN Framework, ICICT 2020: Paper
  • ForensicTransfer: Weakly-supervised Domain Adaptation for Forgery Detection, arXiv 2018: Paper

Interpretability

  • Explaining Deepfake Detection by Analysing Image Matching, ECCV 2022: Paper
  • Detecting and Recovering Sequential DeepFake Manipulation, ECCV 2022: Paper Github
  • Quantitative Metrics for Evaluating Explanations of Video DeepFake Detectors, arXiv 2022: Paper
  • Interpretable and Trustworthy Deepfake Detection via Dynamic Prototypes, WACV 2021: Paper
  • Supervised Contrastive Learning for Generalizable and Explainable DeepFakes Detection, WACV 2021: Paper Github
  • Interpretable and Trustworthy Deepfake Detection via Dynamic Prototypes, WACV 2021: Paper
  • What’s wrong with this video? Comparing Explainers for Deepfake Detection, arXiv 2021: Paper
  • PRRNet: Pixel-Region relation network for face forgery detection, Pattern Recognition 2021: Paper
  • What makes fake images detectable? Understanding properties that generalize, arXiv 2020: Paper Github

Human-Decision

  • Video Manipulations Beyond Faces: A Dataset with Human-Machine Analysis, WACV 2023: Paper
  • Understanding Users’ Deepfake Video Verification Strategies, International Conference on Human-Computer Interaction 2022: Paper
  • Crowd–powered Face Manipulation Detection: Fusing Human Examiner Decisions, arXiv 2022: Paper
  • Deepfake Caricatures: Amplifying attention to artifacts increases deepfake detection by humans and machines, arXiv 2022: Paper

Localization

  • LAA-Net: Localized Artifact Attention Network for Quality-Agnostic and Generalizable Deepfake Detection, CVPR 2024: Paper Github
  • Hierarchical Fine-Grained Image Forgery Detection and Localization, CVPR 2023: Paper Github
  • Region-Aware Temporal Inconsistency Learning for DeepFake Video Detection, IJCAI 2022: Paper
  • Exposing Face Forgery Clues via Retinex-based Image Enhancement, ACCV 2022: Paper
  • Exploring Spatial-Temporal Features for Deepfake Detection and Localization, arXiv 2022: Paper Github
  • DeepFake Detection Based on Discrepancies Between Faces and their Context, TPAMI 2021: Paper
  • Dlfmnet: End-to-end detection and localization of face manipulation using multi-domain features, ICME 2021: Paper
  • Face X-ray for More General Face Forgery Detection, CVPR 2020: Paper
  • Multi-task Learning For Detecting and Segmenting Manipulated Facial Images and Videos, BATS 2019: Paper

Multi-modal Based

  • AVFF: Audio-Visual Feature Fusion for Video Deepfake Detection, CVPR 2024: Paper
  • Lost in Translation: Lip-Sync Deepfake Detection from Audio-Video Mismatch, CVPR Workshop 2024: Paper
  • AVoiD-DF: Audio-Visual Joint Learning for Detecting Deepfake, TIFS 2023: Paper
  • M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection, ICMR 2022: Paper
  • Voice-Face Homogeneity Tells Deepfake, arXiv 2022: Paper
  • Audio-Visual Person-of-Interest DeepFake Detection, arXiv 2022: Paper Github
  • Do You Really Mean That? Content Driven Audio-Visual Deepfake Dataset and Multimodal Method for Temporal Forgery Localization, arXiv 2022: Paper
  • Lip Sync Matters: A Novel Multimodal Forgery Detector, APSIPA 2022: Paper
  • Multimodal Forgery Detection Using Ensemble Learning, APSIPA 2022: Paper
  • Deepfake Video Detection Based on Spatial, Spectral, and Temporal Inconsistencies Using Multimodal Deep Learning, AIPR 2020: Paper

Biological Signal

  • Local attention and long-distance interaction of rPPG for deepfake detection, The Visual Computer 2023: Paper
  • Benchmarking Joint Face Spoofing and Forgery Detection with Visual and Physiological Cues, arXiv 2022: Paper
  • Visual Representations of Physiological Signals for Fake Video Detection, arXiv 2022: Paper
  • Study of detecting behavioral signatures within DeepFake videos, arXiv 2022: Paper
  • Detecting Deep-Fake Videos from Aural and Oral Dynamics, CVPR Workshop 2021: Paper
  • Countering Spoof: Towards Detecting Deepfake with Multidimensional Biological Signals, Security and Communication Networks 2021: Paper
  • A Study on Effective Use of BPM Information in Deepfake Detection, ICTC 2021: Paper
  • Exposing Deepfake with Pixel-wise Autoregressive and PPG Correlation from Faint Signals, arXiv 2021: Paper
  • FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals, TPAMI 2020: Paper
  • How Do the Hearts of Deep Fakes Beat? Deep Fake Source Detection via Interpreting Residuals with Biological Signals, IJCB 2020: Paper
  • DeepFakesON-Phys: DeepFakes Detection based on Heart Rate Estimation, arXiv 2020: Paper Github
  • Predicting Heart Rate Variations of Deepfake Videos using Neural ODE, ICCV Workshop 2019: Paper

Robustness

  • LAA-Net: Localized Artifact Attention Network for Quality-Agnostic and Generalizable Deepfake Detection, CVPR 2024: Paper Github
  • Quality-Agnostic Deepfake Detection with Intra-model Collaborative Learning, ICCV 2023: Paper

Fairness

  • Preserving Fairness Generalization in Deepfake Detection, CVPR 2024: Paper Github
  • GBDF: Gender Balanced DeepFake Dataset Towards Fair DeepFake Detection, ICPR 2022: Paper Github
  • A Comprehensive Analysis of AI Biases in DeepFake Detection With Massively Annotated Databases, arXiv 2022: Paper Github
  • An Examination of Fairness of AI Models for Deepfake Detection, IJCAI 2021: Paper

Fingerprint Watermark

  • Responsible Disclosure of Generative Models Using Scalable Fingerprinting, ICLR 2022: Paper Github
  • DeepFake Disrupter: The Detector of DeepFake Is My Friend, CVPR 2022: Paper
  • FingerprintNet: Synthesized Fingerprints for Generated Image Detection, ECCV 2022: Paper
  • CMUA-Watermark: A Cross-Model Universal Adversarial Watermark for Combating Deepfakes, AAAI 2022: Paper Github
  • Defeating DeepFakes via Adversarial Visual Reconstruction, ACM MM 2022: Paper
  • DeepFakes for Privacy: Investigating the Effectiveness of State-of-the-Art Privacy-Enhancing Face Obfuscation Methods, Proceedings of the 2022 International Conference on Advanced Visual Interfaces 2022: Paper
  • Metamorphic Testing-based Adversarial Attack to Fool Deepfake Detectors, ICPR 2022: Paper
  • FaceSigns: Semi-Fragile Neural Watermarks for Media Authentication and Countering Deepfakes, arXiv 2022: Paper Github
  • Anti-Forgery: Towards a Stealthy and Robust DeepFake Disruption Attack via Adversarial Perceptual-aware Perturbations, arXiv 2022: Paper Github
  • System Fingerprints Detection for DeepFake Audio: An Initial Dataset and Investigation, arXiv 2022: Paper
  • Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Data, ICCV 2021: Paper Github
  • FaceGuard: Proactive Deepfake Detection, CoRR 2021: Paper

Identity-Related

  • TI2Net: Temporal Identity Inconsistency Network for Deepfake Detection, WACV 2023: Paper
  • Protecting Celebrities from DeepFake with Identity Consistency Transformer, CVPR 2022: Paper Github
  • Protecting World Leader Using Facial Speaking Pattern Against Deepfakes, IEEE Signal Processing Letters 2022: Paper
  • Protecting world leaders against deep fakes using facial, gestural, and vocal mannerisms, Proceedings of the National Academy of Sciences 2022: Paper
  • Study of detecting behavioral signatures within DeepFake videos, arXiv 2022: Paper
  • Voice-Face Homogeneity Tells Deepfake, arXiv 2022: Paper
  • Audio-Visual Person-of-Interest DeepFake Detection, arXiv 2022: Paper Github
  • Detecting Deep-Fake Videos from Aural and Oral Dynamics, CVPR Workshop 2021: Paper
  • ID-Reveal: Identity-aware DeepFake Video Detection, ICCV 2021: Paper Github
  • This Face Does Not Exist... But It Might Be Yours! Identity Leakage in Generative Models, WACV 2021: Paper
  • An Experimental Evaluation on Deepfake Detection using Deep Face Recognition, ICCST 2021: Paper
  • Detecting Deep-Fake Videos from Appearance and Behavior, WIFS 2020: Paper
  • Identity-Driven DeepFake Detection, arXiv 2020: Paper
  • Protecting World Leaders Against Deep Fakes, CVPR Workshop 2019: Paper

Adversarial Attack

  • Poisoned Forgery Face: Towards Backdoor Attacks on Face Forgery Detection, ICLR 2024: Paper Github
  • Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detection, CVPR 2022: Paper Github
  • Exploring Frequency Adversarial Attacks for Face Forgery Detection, CVPR 2022: Paper
  • TAFIM: Targeted Adversarial Attacks against Facial Image Manipulations, ECCV 2022: Paper Github
  • Anti-Forgery: Towards a Stealthy and Robust DeepFake Disruption Attack via Adversarial Perceptual-aware Perturbations, IJCAI 2022: Paper Github
  • Investigate Evolutionary Strategies for Black-box Attacks to Deepfake Forensic Systems, SoICT 2022: Paper
  • Evaluating Robustness of Sequence-based Deepfake Detector Models by Adversarial Perturbation, WDC 2022: Paper
  • Restricted Black-box Adversarial Attack Against DeepFake Face Swapping, CoRR 2022: Paper

Real Scenario

  • Contrastive Pseudo Learning for Open-World DeepFake Attribution, ICCV 2023: Paper
  • A Continual Deepfake Detection Benchmark: Dataset, Methods, and Essentials, WACV 2023: Paper
  • Robust Image Forgery Detection Against Transmission Over Online Social Networks, TIFS 2022: Paper Github
  • Am I a Real or Fake Celebrity? Evaluating Face Recognition and Verification APIs under Deepfake Impersonation Attack, Proceedings of the ACM Web Conference 2022: Paper Github
  • DeSI: Deepfake Source Identifier for Social Media, CVPR Workshop 2022: Paper
  • Investigate Evolutionary Strategies for Black-box Attacks to Deepfake Forensic Systems, SoICT 2022: Paper
  • Seeing is Living? Rethinking the Security of Facial Liveness Verification in the Deepfake Era, CoRR 2022: Paper
  • DeFakePro: Decentralized DeepFake Attacks Detection using ENF Authentication, arXiv 2022: Paper
  • DF-Captcha: A Deepfake Captcha for Preventing Fake Calls, arXiv 2022: Paper
  • Practical Deepfake Detection: Vulnerabilities in Global Contexts, arXiv 2022: Paper
  • My Face My Choice: Privacy Enhancing Deepfakes for Social Media Anonymization, arXiv 2022: Paper
  • Preventing DeepFake Attacks on Speaker Authentication by Dynamic Lip Movement Analysis, TIFS 2021: Paper Github
  • Real, Forged or Deep Fake? Enabling the Ground Truth on the Internet, IEEE Access 2021: Paper
  • DeepFake-o-meter: An Open Platform for DeepFake Detection, SP Workshop 2021: Paper
  • Towards Untrusted Social Video Verification to Combat Deepfakes via Face Geometry Consistency, CVPR Workshop 2020: Paper

Anomaly Detection

  • Self-Supervised Video Forensics by Audio-Visual Anomaly Detection, arXiv 2023: Paper Github
  • Learning Second Order Local Anomaly for General Face Forgery Detection, CVPR 2022: Paper
  • SeeABLE: Soft Discrepancies and Bounded Contrastive Learning for Exposing Deepfakes, arXiv 2022: Paper
  • Differential Anomaly Detection for Facial Images, WIFS 2021: Paper
  • Fighting Deepfakes by Detecting GAN DCT Anomalies, Journal of Imaging 2021: Paper

Self-Supervised Learning

  • Self-Supervised Video Forensics by Audio-Visual Anomaly Detection, arXiv 2023: Paper Github
  • End-to-End Reconstruction-Classification Learning for Face Forgery Detection, CVPR 2022: Paper
  • Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection, CVPR 2022: Paper
  • UIA-ViT: Unsupervised Inconsistency-Aware Method based on Vision Transformer for Face Forgery Detection, ECCV 2022: Paper
  • Dual Contrastive Learning for General Face Forgery Detection, AAAI 2022: Paper
  • Self-supervised Transformer for Deepfake Detection, arXiv 2022: Paper
  • MagDR: Mask-guided Detection and Reconstruction for Defending Deepfakes, CVPR 2021: Paper
  • DeepfakeUCL: Deepfake Detection via Unsupervised Contrastive Learning, IJCNN 2021: Paper
  • Deepfake videos detection using self-supervised decoupling network, ICME 2021: Paper
  • Detecting Deep-Fake Videos from Appearance and Behavior, WIFS 2020: Paper

Source Model Attribution

  • Deepfake Network Architecture Attribution, AAAI 2022: Paper Github
  • Model Attribution of Face-swap Deepfake Videos, ICIP 2022: Paper
  • On the Exploitation of Deepfake Model Recognition, CVPR Workshop 2022: Paper
  • Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Data, ICCV 2021: Paper Github
  • Towards Discovery and Attribution of Open-world GAN Generated Images, ICCV 2021: Paper
  • Improving Generalization of Deepfake Detection by Training for Attribution, MMSP 2021: Paper
  • How Do the Hearts of Deep Fakes Beat? Deep Fake Source Detection via Interpreting Residuals with Biological Signals, IJCB 2020: Paper
  • Attributing Fake Images to GANs: Learning and Analyzing GAN Fingerprints, ICCV 2019: Paper
  • On Attribution of Deepfakes, arXiv 2020: Paper
  • Scalable Fine-grained Generated Image Classification Based on Deep Metric Learning, CoRR 2019: Paper

Multiclass Classification

  • Three-classification Face Manipulation Detection Using Attention-based Feature Decomposition, Computers & Security 2022: Paper
  • Forgery-Domain-Supervised Deepfake Detection with Non-Negative Constraint, IEEE Signal Processing Letters 2022: Paper

Federated Learning

  • FedForgery: Generalized Face Forgery Detection with Residual Federated Learning, arXiv 2022: Paper Github

Knowledge Distillation

  • Confidence-Calibrated Face Image Forgery Detection with Contrastive Representation Distillation, ACCV 2022: Paper Github

Meta-Learning

  • Domain General Face Forgery Detection by Learning to Weight, AAAI 2021: Paper Github

Depth Based

  • A guided-based approach for deepfake detection: RGB-depth integration via features fusion, Pattern Recognition Letters 2024: Paper Github
  • DepthFake: a depth-based strategy for detecting Deepfake videos, arXiv 2022: Paper
  • Exploring Depth Information for Face Manipulation Detection, arXiv 2022: Paper