COMPUTER SYSTEM FOR REAL-TIME AUTOMATIC PIANO TRANSCRIPTION AND REPERFORMANCE WITH PITCH INTENSITY AND PEDAL ESTIMATION AND METHOD THEREOF

Various embodiments relate to a computer system for a real-time automatic transcription and reproduction of a pitch, velocity, and pedal of a piano performance and a method therefor, wherein the method may be configured to: obtain a sound source for a piano performance; predict the intensity for eac...

Full description

Saved in:
Bibliographic Details
Main Authors NAM JUHAN, KWON TAEGYUN, JEONG DASAEM
Format Patent
LanguageEnglish
Korean
Published 01.07.2022
Subjects
ACOUSTICS
CALCULATING
COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
COMPUTING
COUNTING
ELECTROPHONIC MUSICAL INSTRUMENTS
MUSICAL INSTRUMENTS
PHYSICS
Online AccessGet full text

Cover

More Information
Summary:Various embodiments relate to a computer system for a real-time automatic transcription and reproduction of a pitch, velocity, and pedal of a piano performance and a method therefor, wherein the method may be configured to: obtain a sound source for a piano performance; predict the intensity for each of the musical notes while predicting each of the states for the musical notes in a frame as one value, based on a spectrogram of each frame for the sound source; detect the pedal information, based on the states of the musical notes; generate sheet music using the pitches of the musical notes, the intensity for each of the musical notes, and the pedal information; and reproduce the piano performance, using the sheet music. 다양한 실시예들은 피아노 연주의 음정, 세기, 페달의 실시간 자동 채보 및 재현을 위한 컴퓨터 시스템 및 그의 방법에 관한 것으로, 피아노 연주에 대한 음원을 획득하고, 음원에 대한 각 프레임의 스펙트로그램(spectrogram)을 기반으로, 프레임 내 음표들에 대한 상태들의 각각을 하나의 값으로 예측하면서 음표들의 각각에 대한 세기(intensity)를 예측하고, 음표들의 상태들을 기반으로, 페달(pedal) 정보를 검출하고, 음표들의 음정(pitch)들과 음표들의 각각에 대한 세기, 및 페달 정보를 이용하여, 악보를 생성하고, 악보를 이용하여, 피아노 연주를 재현하도록 구성될 수 있다.
Bibliography:Application Number: KR20210017377