政大機構典藏-National Chengchi University Institutional Repository(NCCUR):Item 140.119/157013

English | 正體中文 | 简体中文 | Post-Print筆數 : 27 | Items with full text/Total items : 116112/147149 (79%)
Visitors : 59375105 Online Users : 1123

RC Version 6.0 © Powered By DSPACE, MIT. Enhanced by NTU Library IR team.

Home ‧ Login ‧ Upload ‧ Help ‧ About ‧ Administer

政大機構典藏 > 資訊學院 > 資訊科學系 > 會議論文 > Item 140.119/157013

Please use this identifier to cite or link to this item: https://nccur.lib.nccu.edu.tw/handle/140.119/157013

Title:	Unveiling the Potential of SSL-Generated Audio Embeddings for Cross-Lingual Speaker Recognition
Authors:	廖文宏 Liao, Wen-Hung;Chen, Po-Han;Wu, Yi-Chieh
Contributors:	資訊系
Keywords:	Cross-lingual speaker recognition;Self-supervised learning;Audio embeddings;Data augmentation for audio
Date:	2024-12
Issue Date:	2025-05-19 11:44:32 (UTC+8)
Abstract:	This research explores the effectiveness of SSL-based audio embeddings in cross-lingual speaker recognition. We collected speech data from 120 participants, named MET-120 in which each participant recorded in three languages (Mandarin, English, and Taiwanese). We then employ self-supervised learning (SSL) pre-trained models, including Wav2vec 2.0 and BEATs, to extract audio features that can characterize the speaker. A simple residual neural network (ResNet) is trained to perform cross-lingual speaker recognition tasks. Experimental results show that the fine-tuned Wav2vec 2.0 model achieves over 90% average performance on MET-120, obtaining the best overall results. Without fine-tuning, BEATs achieves 80% average performance on MET-120, suggesting that it might serve as a soft biometric in cross-lingual scenarios. The influence of native or proficient languages on recognition results is observed. Furthermore, we evaluate the efficacy of acoustic data augmentation schemes such as SpecAugment and ShuffleAugment. Experimental results demonstrate that ShuffleAugment, when used alongside dimensionality-reduction techniques like PCA, significantly improves performance in both same-language and cross-lingual tests.
Relation:	2024 International Symposium on Multimedia (ISM), IEEE Technical Committee on Multimedia (TCMC)
Data Type:	conference
DOI 連結:	https://doi.org/10.1109/ISM63611.2024.00010
DOI:	10.1109/ISM63611.2024.00010
Appears in Collections:	[資訊科學系] 會議論文

Files in This Item:

File	Description	Size	Format
index.html		0Kb	HTML	52	View/Open

社群 sharing

著作權政策宣告 Copyright Announcement

1.本網站之數位內容為國立政治大學所收錄之機構典藏，無償提供學術研究與公眾教育等公益性使用，惟仍請適度，合理使用本網站之內容，以尊重著作權人之權益。商業上之利用，則請先取得著作權人之授權。
The digital content of this website is part of National Chengchi University Institutional Repository. It provides free access to academic research and public education for non-commercial use. Please utilize it in a proper and reasonable manner and respect the rights of copyright owners. For commercial use, please obtain authorization from the copyright owner in advance.

2.本網站之製作，已盡力防止侵害著作權人之權益，如仍發現本網站之數位內容有侵害著作權人權益情事者，請權利人通知本網站維護人員(nccur@nccu.edu.tw)，維護人員將立即採取移除該數位著作等補救措施。
NCCU Institutional Repository is made to protect the interests of copyright owners. If you believe that any material on the website infringes copyright, please contact our staff(nccur@nccu.edu.tw). We will remove the work from the repository and investigate your claim.

Loading...