dorsal/arxiv
View SchemaESDD2: Environment-Aware Speech and Sound Deepfake Detection Challenge Evaluation Plan
| Authors | Xueping Zhang, Han Yin, Yang Xiao, Lin Zhang, Ting Dang, Rohan Kumar Das, Ming Li |
|---|---|
| Categories | |
| ArXiv ID | 2601.07303vv1 |
| URL | https://arxiv.org/abs/2601.07303 |
| License | http://creativecommons.org/licenses/by-nc-nd/4.0/ |
Abstract
Audio recorded in real-world environments often contains a mixture of foreground speech and background environmental sounds. With rapid advances in text-to-speech, voice conversion, and other generation models, either component can now be modified independently. Such component-level manipulations are harder to detect, as the remaining unaltered component can mislead the systems designed for whole deepfake audio, and they often sound more natural to human listeners. To address this gap, we have proposed CompSpoofV2 dataset and a separation-enhanced joint learning framework. CompSpoofV2 is a large-scale curated dataset designed for component-level audio anti-spoofing, which contains over 250k audio samples, with a total duration of approximately 283 hours. Based on the CompSpoofV2 and the separation-enhanced joint learning framework, we launch the Environment-Aware Speech and Sound Deepfake Detection Challenge (ESDD2), focusing on component-level spoofing, where both speech and environmental sounds may be manipulated or synthesized, creating a more challenging and realistic detection scenario. The challenge will be held in conjunction with the IEEE International Conference on Multimedia and Expo 2026 (ICME 2026).
{
"annotation_id": "6d088d5f-0e0b-4eb2-879a-b4cded204070",
"date_created": "2026-02-17T05:53:12.581000Z",
"date_modified": "2026-02-17T05:53:12.581000Z",
"file_hash": "a394beed57ac8d649ad502f8c617807d05c56b1389fed00d734294a9e08bc0d7",
"private": false,
"record": {
"abstract": "Audio recorded in real-world environments often contains a mixture of foreground speech and background environmental sounds. With rapid advances in text-to-speech, voice conversion, and other generation models, either component can now be modified independently. Such component-level manipulations are harder to detect, as the remaining unaltered component can mislead the systems designed for whole deepfake audio, and they often sound more natural to human listeners. To address this gap, we have proposed CompSpoofV2 dataset and a separation-enhanced joint learning framework. CompSpoofV2 is a large-scale curated dataset designed for component-level audio anti-spoofing, which contains over 250k audio samples, with a total duration of approximately 283 hours. Based on the CompSpoofV2 and the separation-enhanced joint learning framework, we launch the Environment-Aware Speech and Sound Deepfake Detection Challenge (ESDD2), focusing on component-level spoofing, where both speech and environmental sounds may be manipulated or synthesized, creating a more challenging and realistic detection scenario. The challenge will be held in conjunction with the IEEE International Conference on Multimedia and Expo 2026 (ICME 2026).",
"arxiv_id": "2601.07303",
"authors": [
"Xueping Zhang",
"Han Yin",
"Yang Xiao",
"Lin Zhang",
"Ting Dang",
"Rohan Kumar Das",
"Ming Li"
],
"categories": [
"cs.SD"
],
"license": "http://creativecommons.org/licenses/by-nc-nd/4.0/",
"title": "ESDD2: Environment-Aware Speech and Sound Deepfake Detection Challenge Evaluation Plan",
"url": "https://arxiv.org/abs/2601.07303",
"version": "v1"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "1729a287-f781-405f-a336-87deef79d5f7",
"id": "arXiv Dataset",
"type": "Model",
"variant": "snapshot-2026-01-17",
"version": "0.1.0"
},
"user_id": 1000002
}