Score-Informed Source Separation for Multichannel Orchestral Recordings

This paper proposes a system for score-informed audio source separation for multichannel orchestral recordings. The orchestral music repertoire relies on the existence of scores. Thus, a reliable separation requires a good alignment of the score with the audio of the performance. To that extent, aut...

Full description

Saved in:
Bibliographic Details
Published inJournal of Electrical and Computer Engineering Vol. 2016; no. 2016; pp. 929 - 947
Main Authors Gómez, Emilia, Bosch, Juan J., Carabias-Orti, Julio J., Miron, Marius, Janer, Jordi
Format Journal Article
LanguageEnglish
Published Cairo, Egypt Hindawi Limiteds 01.01.2016
Hindawi Publishing Corporation
John Wiley & Sons, Inc
Hindawi Limited
Hindawi
Subjects
Alignment
Design engineering
Enginyeria acústica
Enregistrament i reproducció
Multichannel
Orchestral music
Recording
Separation
Tasks
Technology application
Tolerances
Online AccessGet full text

Cover

More Information
Summary:This paper proposes a system for score-informed audio source separation for multichannel orchestral recordings. The orchestral music repertoire relies on the existence of scores. Thus, a reliable separation requires a good alignment of the score with the audio of the performance. To that extent, automatic score alignment methods are reliable when allowing a tolerance window around the actual onset and offset. Moreover, several factors increase the difficulty of our task: a high reverberant image, large ensembles having rich polyphony, and a large variety of instruments recorded within a distant-microphone setup. To solve these problems, we design context-specific methods such as the refinement of score-following output in order to obtain a more precise alignment. Moreover, we extend a close-microphone separation framework to deal with the distant-microphone orchestral recordings. Then, we propose the first open evaluation dataset in this musical context, including annotations of the notes played by multiple instruments from an orchestral ensemble. The evaluation aims at analyzing the interactions of important parts of the separation framework on the quality of separation. Results show that we are able to align the original score with the audio of the performance and separate the sources corresponding to the instrument sections.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:2090-0147
2090-0155
DOI:10.1155/2016/8363507