Tag Propagation and Cost-Sensitive Learning for Music Auto-Tagging

• Published in: IEEE transactions on multimedia Vol. 23; pp. 1605 - 1616
• Main Authors: Lin, Yi-Hsun, Chen, Homer H.
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2021; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Context; cost-sensitive learning; Learning; Links; Marking; Multimedia systems; Music; Music auto-tagging; music information retrieval; Musical performances; Performance enhancement; Propagation; Propagation losses; Social networking (online); tag propagation; Tagging; Tags; Training; Training data; Two dimensional models
• ISSN: 1520-9210; 1941-0077
• DOI: 10.1109/TMM.2020.3001521

The performance of music auto-tagging depends on the quality of training data. In practice, the links between songs and tags in the manually labeled training data can be incorrect (false positive) or missing (false negative). In this paper, we propose a cost-sensitive tag propagation learning method to improve auto-tagging. Specifically, we exploit music context to determine similar songs and propagate tags between them. Both propagated tags and original tags are used to optimize the auto-tagging models, and cost-sensitivity is incorporated into the loss function to enhance the robustness by adjusting the weight of relevant ( positive ) links with respect to irrelevant ( negative ) links. The proposed method is tested on three auto-tagging models: 2D-CNN, CRNN, and SampleCNN. The Million Song Dataset is used for training, and four music contexts, artist, playlist, tag, and listener, are used for song similarity measurement. The experimental results show 1) The proposed method can successfully improve the performance of the three auto-tagging models, 2) The cost-sensitive loss function helps reduce the impact of missing tags, and 3) The artist music context is more powerful for tag propagation than the other three music contexts.