政大機構典藏-National Chengchi University Institutional Repository(NCCUR):Item 140.119/149882

English | 正體中文 | 简体中文 | Post-Print筆數 : 27 | Items with full text/Total items : 113656/144643 (79%)
Visitors : 51726808 Online Users : 594

RC Version 6.0 © Powered By DSPACE, MIT. Enhanced by NTU Library IR team.

Home ‧ Login ‧ Upload ‧ Help ‧ About ‧ Administer

政大典藏 > College of Informatics > Department of Computer Science > Proceedings > Item 140.119/149882

Please use this identifier to cite or link to this item: https://nccur.lib.nccu.edu.tw/handle/140.119/149882

Title:	Lip Sync Matters: A Novel Multimodal Forgery Detector
Authors:	彭彥璁 Peng, Yan-Tsung;Shahzad, Sahibzada Adil;Hashmi, Ammarah;Khan, Sarwar;Tsao, Yu;Wang, Hsin-Min
Contributors:	資訊系
Date:	2022-11
Issue Date:	2024-02-16 15:36:53 (UTC+8)
Abstract:	Deepfake technology has advanced a lot, but it is a double-sided sword for the community. One can use it for beneficial purposes, such as restoring vintage content in old movies, or for nefarious purposes, such as creating fake footage to manipulate the public and distribute non-consensual pornography. A lot of work has been done to combat its improper use by detecting fake footage with good performance thanks to the availability of numerous public datasets and unimodal deep learning-based models. However, these methods are insufficient to detect multimodal manipulations, such as both visual and acoustic. This work proposes a novel lip-reading-based multi-modal Deepfake detection method called “Lip Sync Matters.” It targets high-level semantic features to exploit the mismatch between the lip sequence extracted from the video and the synthetic lip sequence generated from the audio by the Wav2lip model to detect forged videos. Experimental results show that the proposed method outperforms several existing unimodal, ensemble, and multimodal methods on the publicly available multimodal FakeAVCeleb dataset.
Relation:	Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), IEEE
Data Type:	conference
DOI link:	https://doi.org/10.23919/APSIPAASC55919.2022.9980296
DOI:	10.23919/APSIPAASC55919.2022.9980296
Appears in Collections:	[Department of Computer Science ] Proceedings

Files in This Item:

File	Description	Size	Format
index.html		0Kb	HTML	87	View/Open

社群 sharing

著作權政策宣告 Copyright Announcement

1.本網站之數位內容為國立政治大學所收錄之機構典藏，無償提供學術研究與公眾教育等公益性使用，惟仍請適度，合理使用本網站之內容，以尊重著作權人之權益。商業上之利用，則請先取得著作權人之授權。
The digital content of this website is part of National Chengchi University Institutional Repository. It provides free access to academic research and public education for non-commercial use. Please utilize it in a proper and reasonable manner and respect the rights of copyright owners. For commercial use, please obtain authorization from the copyright owner in advance.

2.本網站之製作，已盡力防止侵害著作權人之權益，如仍發現本網站之數位內容有侵害著作權人權益情事者，請權利人通知本網站維護人員(nccur@nccu.edu.tw)，維護人員將立即採取移除該數位著作等補救措施。
NCCU Institutional Repository is made to protect the interests of copyright owners. If you believe that any material on the website infringes copyright, please contact our staff(nccur@nccu.edu.tw). We will remove the work from the repository and investigate your claim.

Loading...