Partially Edited Audio: Generation, Defense, and Open Problems
Lin Zhang, You Zhang, Nicholas Evans, Xin Wang, David Harwath, Abhinav Dhall, Bowen Shi, Chengzhe Sun, Siwei Lyu, Sanjeev Khudanpur
Abstract
Recent advances in generative audio models facilitate increasingly flexible and selective editing of linguistic content and paralinguistic, extralinguistic, and other attributes. This paradigm, named partially edited audio, differs from full audio generation as only portions of the real recording are edited. This technique can serve both beneficial and harmful applications. We therefore present a concise survey from both generation and defense perspectives, focusing on audio, as a contribution to the ICASSP 2027 special session entitled "Partially Edited Media: Perspectives from Synthesis and Defense." We first define partially edited audio and argue that what counts as ``fake'' or harmful is an application-dependent judgment, not a fixed property of the edit. We then survey audio editing by editing target, approaches, and evaluation, and then defense methods by detection, localization, diarization, and interpretability, summarizing representative benchmarks and toolkits. Finally, we discuss future directions and open problems.
Create a lesson
Related papers
Beyond Answer Changes: Matched Same-Class Controls for Local Audio Evidence
Yunuo Wang, Maoyuan Chen, Yuanjin Huang et al.
Understanding Everyday Communication Patterns, Stress, and Productivity in Hybrid Work through Egocentric Wearable Audio Sensing
Tiantian Feng, Aditya Kommineni, Emily Zhou et al.
EEG-Based Decoding of Musical Mode and Melodic Direction Using Empirical Mode Decomposition
Sergio Guillén, Lorenzo J. Tardón, Ana M. Barbancho et al.
Design and Architecture of Airmod: An Active Noise Cancellation and Deep Learning System for Real-Time Respiratory Rate Estimation from Tracheal Sounds
Shang-Ran Huang, Fu-Shun Hsu, Ji-Chang Huang et al.
Physiology-Informed Audio Quality and Listening Effort Estimation
Niall McGuire, Dimitra Emmanouilidou
Expressive Guitar Synthesis via Controllable Latent Flow Matching
Hsueh-Wei Fu, Yen-Tung Yeh, Yi-Hsuan Yang