[PDF] PolyGlotFake: A Novel Multilingual and Multimodal DeepFake Dataset | Semantic Scholar (2024)

Skip to search formSkip to main contentSkip to account menu

Semantic ScholarSemantic Scholar's Logo
  • Corpus ID: 269773335
@inproceedings{Hou2024PolyGlotFakeAN, title={PolyGlotFake: A Novel Multilingual and Multimodal DeepFake Dataset}, author={Yang Hou and Haitao Fu and Chuankai Chen and Zida Li and Haoyu Zhang and Jianjun Zhao}, year={2024}, url={https://api.semanticscholar.org/CorpusID:269773335}}
  • Yang Hou, Haitao Fu, Jianjun Zhao
  • Published 14 May 2024
  • Computer Science, Linguistics

This work proposes a novel, multilingual, and multimodal deepfake dataset, PolyGlotFake, which includes content in seven languages, created using a variety of cutting-edge and popular Text-to-Speech, voice cloning, and lip-sync technologies.

Figures and Tables from this paper

  • table 1
  • figure 2
  • table 2
  • figure 3
  • table 3
  • table 4
  • figure 4
  • table 5

Ask This Paper

BETA

AI-Powered

Our system tries to constrain to information found in this paper. Results quality may vary. Learn more about how we generate these answers.

Feedback?

42 References

The DeepFake Detection Challenge (DFDC) Dataset.
    Brian DolhanskyJoanna Bitton Cristian Cantón Ferrer

    Computer Science

  • 2020

Although Deep fake detection is extremely difficult and still an unsolved problem, a Deepfake detection model trained only on the DFDC can generalize to real "in-the-wild" Deepfake videos, and such a model can be a valuable analysis tool when analyzing potentially Deepfaked videos.

  • 314
  • Highly Influential
Generation and detection of manipulated multimodal audiovisual content: Advances, trends and open challenges
    Helena Liz-LópezMamadou KeitaAbdelmalik Taleb-AhmedA. HadidJavier Huertas-TatoDavid Camacho

    Computer Science

    Inf. Fusion

  • 2024
  • 4
DF-Platter: Multi-Face Heterogeneous Deepfake Dataset
    Kartik NarayanHarsh AgarwalK. ThakralS. MittalMayank VatsaRicha Singh

    Computer Science

    2023 IEEE/CVF Conference on Computer Vision and…

  • 2023

It is assertion that this database will improve the state-of-the-art by extending the capabilities of deepfake detection algorithms to real-world scenarios by proposing the DF-Platter dataset, which contains both low-resolution and high-resolution deepfakes generated using multiple generation techniques.

  • 15
  • PDF
Evading DeepFake Detectors via Adversarial Statistical Consistency
    Yang HouQing GuoYihao HuangXiaofei XieL. MaJianjun Zhao

    Computer Science

    2023 IEEE/CVF Conference on Computer Vision and…

  • 2023

This work proposes a statistical consistency attack (StatAttack) against DeepFake detectors, and finds that the statistical differences between natural and DeepFake images are positively associated with the distribution shifting between the two kinds of images, and is proposed to use a distribution-aware loss to guide the optimization of different degradations.

Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers
    Chengyi WangSanyuan Chen Furu Wei

    Computer Science

    ArXiv

  • 2023

Vall-E significantly outperforms the state-of-the-art zero-shot TTS system in terms of speech naturalness and speaker similarity, and is found to preserve the speaker's emotion and acoustic environment of the acoustic prompt in synthesis.

VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild
    K. ChengXiaodong Cun Nan Wang

    Computer Science

    SIGGRAPH Asia

  • 2022

We present VideoReTalking, a new system to edit the faces of a real-world talking head video according to input audio, producing a high-quality and lip-syncing output video even with a different

Freevc: Towards High-Quality Text-Free One-Shot Voice Conversion
    Jingyi LiWeiping TuLi Xiao

    Computer Science

    ICASSP 2023 - 2023 IEEE International Conference…

  • 2023

This paper adopts the end-to-end framework of VITS for high-quality waveform reconstruction, and proposes strategies for clean content information extraction without text annotation and the spectrogram-resize based data augmentation to improve the purity of extracted content information.

End-to-End Reconstruction-Classification Learning for Face Forgery Detection
    Junyi CaoChao MaTaiping YaoShen ChenShouhong DingXiaokang Yang

    Computer Science

    2022 IEEE/CVF Conference on Computer Vision and…

  • 2022

This paper proposes a forgery detection frame-work emphasizing the common compact representations of genuine faces based on reconstruction-classification learning, and builds bipartite graphs over the encoder and decoder features in a multi-scale fashion.

  • 100
  • PDF
CORE: Consistent Representation Learning for Face Forgery Detection
    Yu-Shu NiDepu MengChangqian YuChengbin QuanDongchun RenYoujian Zhao

    Computer Science

    2022 IEEE/CVF Conference on Computer Vision and…

  • 2022

This work constrain the consistency of different representations explicitly and proposes a simple yet effective framework, COnsistent REpresentation Learning (CORE), which first captures the different representations with different augmentations, then regularize the cosine distance of the representations to enhance the consistency.

Exploring Frequency Adversarial Attacks for Face Forgery Detection
    Shuai JiaChao MaTaiping YaoBangjie YinShouhong DingXiaokang Yang

    Computer Science

    2022 IEEE/CVF Conference on Computer Vision and…

  • 2022

This paper proposes a frequency adversarial attack method against face forgery detectors that fools not only the spatial-based detectors but also the state-of- the-art frequency-based detector effectively and enhances the transferability across face forgeries detectors as black-box attacks.

...

...

Related Papers

Showing 1 through 3 of 0 Related Papers

    [PDF] PolyGlotFake: A Novel Multilingual and Multimodal DeepFake Dataset | Semantic Scholar (2024)
    Top Articles
    Latest Posts
    Article information

    Author: Dan Stracke

    Last Updated:

    Views: 6311

    Rating: 4.2 / 5 (63 voted)

    Reviews: 94% of readers found this page helpful

    Author information

    Name: Dan Stracke

    Birthday: 1992-08-25

    Address: 2253 Brown Springs, East Alla, OH 38634-0309

    Phone: +398735162064

    Job: Investor Government Associate

    Hobby: Shopping, LARPing, Scrapbooking, Surfing, Slacklining, Dance, Glassblowing

    Introduction: My name is Dan Stracke, I am a homely, gleaming, glamorous, inquisitive, homely, gorgeous, light person who loves writing and wants to share my knowledge and understanding with you.