MAJEPPA: Morphing and Assessing in a Unified Piano Performance Space
Jinwen Zhou, Huan Zhang, Weixi Zhai, Jinhua Liang, Aidan O. T. Hogg, Simon Dixon
Abstract
We present MAJEPPA, a self-supervised framework to learn piano performance representations that span the full skill spectrum, from beginner practice sessions to virtuoso concert recordings. We curate the MAJEPPA dataset, comprising ~4,000 annotated recordings across six expertise levels and six recording contexts. We adapt a single pre-trained MIDI autoregressive model with a joint objective: next-token prediction learns score-conditioned performance generation at various skill levels, while InfoNCE and supervised contrastive losses align abstract score and performance representations in a joint embedding space. The proposed model both generates and understands performances in a unified framework. By introducing the EVPMR benchmark, a suite of downstream tasks spanning quality assessment, competition ranking, mistake and technique classification, we evaluate the learnt representations, demonstrating progress towards a real-world model for the piano performance space.
Create a lesson
Related papers
GrainSpeech: Less Context, More Detail for Compact Speech Synthesis
Zitao Liang, Chang Gao
Absolute Quality Ratings of Speech Enhancement Systems by Listeners of Different Ages and Degrees of Hearing Loss
Matteo Torcoli, Chih-Wei Wu, Andrea Esposito et al.
Mask-Based Speech Enhancement for Spatial Audio: A Comparison of Ambisonics, Beamforming, and Microphone Channels
Sheli Hendel, Boaz Rafaely, Dorothea Kolossa
Reviving Etter method for autoregressive inpainting: Generalization, evaluation, implementation
Ondřej Mokrý, Matěj Hrdlička, Pavel Rajmic
Correlation-Guided Encoder Selection for Multi-Encoder Large Audio-Language Models
Pei-Jun Liao, Hung-Shin Lee, Wenze Ren et al.
Task-oriented neural FOA encoding for SELD from irregular microphone arrays
Jiachen Liu, Yin Cao, Ming Wu et al.