CURE Dataset: Ladder Networks for Audio Event Classification
Audio event classification is an important task for several applications such as surveillance, audio, video and multimedia retrieval etc. There are approximately 3M people with hearing loss who can't perceive events happening around them. This paper establishes the CURE dataset which contains c...
Saved in:
Published in | arXiv.org |
---|---|
Main Authors | , , |
Format | Paper |
Language | English |
Published |
Ithaca
Cornell University Library, arXiv.org
12.01.2020
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | Audio event classification is an important task for several applications such as surveillance, audio, video and multimedia retrieval etc. There are approximately 3M people with hearing loss who can't perceive events happening around them. This paper establishes the CURE dataset which contains curated set of specific audio events most relevant for people with hearing loss. We propose a ladder network based audio event classifier that utilizes 5s sound recordings derived from the Freesound project. We adopted the state-of-the-art convolutional neural network (CNN) embeddings as audio features for this task. We also investigate extreme learning machine (ELM) for event classification. In this study, proposed classifiers are compared with support vector machine (SVM) baseline. We propose signal and feature normalization that aims to reduce the mismatch between different recordings scenarios. Firstly, CNN is trained on weakly labeled Audioset data. Next, the pre-trained model is adopted as feature extractor for proposed CURE corpus. We incorporate ESC-50 dataset as second evaluation set. Results and discussions validate the superiority of Ladder network over ELM and SVM classifier in terms of robustness and increased classification accuracy. While Ladder network is robust to data mismatches, simpler SVM and ELM classifiers are sensitive to such mismatches, where the proposed normalization techniques can play an important role. Experimental studies with ESC-50 and CURE corpora elucidate the differences in dataset complexity and robustness offered by proposed approaches. |
---|---|
AbstractList | Audio event classification is an important task for several applications such as surveillance, audio, video and multimedia retrieval etc. There are approximately 3M people with hearing loss who can't perceive events happening around them. This paper establishes the CURE dataset which contains curated set of specific audio events most relevant for people with hearing loss. We propose a ladder network based audio event classifier that utilizes 5s sound recordings derived from the Freesound project. We adopted the state-of-the-art convolutional neural network (CNN) embeddings as audio features for this task. We also investigate extreme learning machine (ELM) for event classification. In this study, proposed classifiers are compared with support vector machine (SVM) baseline. We propose signal and feature normalization that aims to reduce the mismatch between different recordings scenarios. Firstly, CNN is trained on weakly labeled Audioset data. Next, the pre-trained model is adopted as feature extractor for proposed CURE corpus. We incorporate ESC-50 dataset as second evaluation set. Results and discussions validate the superiority of Ladder network over ELM and SVM classifier in terms of robustness and increased classification accuracy. While Ladder network is robust to data mismatches, simpler SVM and ELM classifiers are sensitive to such mismatches, where the proposed normalization techniques can play an important role. Experimental studies with ESC-50 and CURE corpora elucidate the differences in dataset complexity and robustness offered by proposed approaches. |
Author | Tashev, Ivan J Emmanouilidou, Dimitra Dubey, Harishchandra |
Author_xml | – sequence: 1 givenname: Harishchandra surname: Dubey fullname: Dubey, Harishchandra – sequence: 2 givenname: Dimitra surname: Emmanouilidou fullname: Emmanouilidou, Dimitra – sequence: 3 givenname: Ivan surname: Tashev middlename: J fullname: Tashev, Ivan J |
BookMark | eNrjYmDJy89LZWLgNDI2NtS1MDEy4mDgLS7OMjAwMDIzNzI1NeZksHEODXJVcEksSSxOLbFS8ElMSUktUvBLLSnPL8ouVkjLL1JwLE3JzFdwLUvNK1FwzkksLs5My0xOLMnMz-NhYE1LzClO5YXS3AzKbq4hzh66BUX5haWpxSXxWfmlRXlAqXigE8zNLAwtzY2MiVMFAP2mOH4 |
ContentType | Paper |
Copyright | 2020. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. |
Copyright_xml | – notice: 2020. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. |
DBID | 8FE 8FG ABJCF ABUWG AFKRA AZQEC BENPR BGLVJ CCPQU DWQXO HCIFZ L6V M7S PIMPY PQEST PQQKQ PQUKI PRINS PTHSS |
DatabaseName | ProQuest SciTech Collection ProQuest Technology Collection Materials Science & Engineering Collection ProQuest Central (Alumni) ProQuest Central ProQuest Central Essentials ProQuest Central Technology Collection ProQuest One Community College ProQuest Central SciTech Premium Collection (Proquest) (PQ_SDU_P3) ProQuest Engineering Collection Engineering Database Publicly Available Content Database ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Academic ProQuest One Academic UKI Edition ProQuest Central China Engineering Collection |
DatabaseTitle | Publicly Available Content Database Engineering Database Technology Collection ProQuest Central Essentials ProQuest One Academic Eastern Edition ProQuest Central (Alumni Edition) SciTech Premium Collection ProQuest One Community College ProQuest Technology Collection ProQuest SciTech Collection ProQuest Central China ProQuest Central ProQuest Engineering Collection ProQuest One Academic UKI Edition ProQuest Central Korea Materials Science & Engineering Collection ProQuest One Academic Engineering Collection |
DatabaseTitleList | Publicly Available Content Database |
Database_xml | – sequence: 1 dbid: 8FG name: ProQuest Technology Collection url: https://search.proquest.com/technologycollection1 sourceTypes: Aggregation Database |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Physics |
EISSN | 2331-8422 |
Genre | Working Paper/Pre-Print |
GroupedDBID | 8FE 8FG ABJCF ABUWG AFKRA ALMA_UNASSIGNED_HOLDINGS AZQEC BENPR BGLVJ CCPQU DWQXO FRJ HCIFZ L6V M7S M~E PIMPY PQEST PQQKQ PQUKI PRINS PTHSS |
ID | FETCH-proquest_journals_23376819723 |
IEDL.DBID | 8FG |
IngestDate | Wed Sep 25 00:28:45 EDT 2024 |
IsOpenAccess | true |
IsPeerReviewed | false |
IsScholarly | false |
Language | English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-proquest_journals_23376819723 |
OpenAccessLink | https://www.proquest.com/docview/2337681972/abstract/?pq-origsite=%requestingapplication% |
PQID | 2337681972 |
PQPubID | 2050157 |
ParticipantIDs | proquest_journals_2337681972 |
PublicationCentury | 2000 |
PublicationDate | 20200112 |
PublicationDateYYYYMMDD | 2020-01-12 |
PublicationDate_xml | – month: 01 year: 2020 text: 20200112 day: 12 |
PublicationDecade | 2020 |
PublicationPlace | Ithaca |
PublicationPlace_xml | – name: Ithaca |
PublicationTitle | arXiv.org |
PublicationYear | 2020 |
Publisher | Cornell University Library, arXiv.org |
Publisher_xml | – name: Cornell University Library, arXiv.org |
SSID | ssj0002672553 |
Score | 3.2524865 |
SecondaryResourceType | preprint |
Snippet | Audio event classification is an important task for several applications such as surveillance, audio, video and multimedia retrieval etc. There are... |
SourceID | proquest |
SourceType | Aggregation Database |
SubjectTerms | Artificial neural networks Classification Classifiers Datasets Feature extraction Hearing Hearing loss Multimedia Robustness Sound recordings Support vector machines |
Title | CURE Dataset: Ladder Networks for Audio Event Classification |
URI | https://www.proquest.com/docview/2337681972/abstract/ |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1bS8MwFD7MFcE3r3iZI6CvoWtaUyuC6Gwt4soYDvY2civ4ss22e_W3mxNXfRD2GAIJCcl3LvlOPoBrY_GuDBJNQ24YjThTVMY8otaXVzLRJhJOJWJU8Hwavc5uZh3I21oYpFW2mOiAWi8V5sh9FtqrcIsiWb6QmAVQjf-w-qSoH4XvrBsxjR3wAvwTD2vGs5ffbAvjsfWdw3-A66xItg_eWKxMdQAdsziEXUe-VPUR3A-nk5Q8i8ZalOaOvCEYVKT4IWjXxLqV5HGtP5YkRXIicTqWyPBxm3oMV1n6PsxpO-V8czzq-d9iwhPo2jjfnAKJeSLkQAWlNfqRNjZ0lAkTPNClKFmZ6DPobRvpfHv3BewxDBUHAQ1YD7pNtTaX1p42su-2qg_eU1qMJ7Y1-kq_AQOwf9M |
link.rule.ids | 786,790,12792,21416,33408,33779,43635,43840 |
linkProvider | ProQuest |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1dS8MwFL1oi-ibn6ibGtDX4JrG1IogOjuqdmWMDfZW0iYFX9xsu_-_m9jpg7DnQEJCcs49NwcOwI1GvCu9UFFfaEa5YAXNA8Ep1vJFHirNpU2JGKYinvL32d2sbbjVra1yjYkWqNW8MD3yW-bjU7g3IVlPi29qUqPM72obobENLvdRqjjgvkTpaPzbZWEiwJrZ_we0lj0G--CO5EJXB7Clvw5hx5oui_oIHvvTcUReZYNM0jyQxIBARdIfY3ZNsJwkz0v1OSeRMSUSm19pnD32MI_hehBN-jFdL5m116LO_jbhn4CD-l6fAglEKPNe4ZVI9lxplIx5yKTwVClLVobqDLqbZjrfPHwFu_FkmGTJW_rRgT1m5GLPox7rgtNUS32BnNrkl-3BrQAMm32c |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=CURE+Dataset%3A+Ladder+Networks+for+Audio+Event+Classification&rft.jtitle=arXiv.org&rft.au=Dubey%2C+Harishchandra&rft.au=Emmanouilidou%2C+Dimitra&rft.au=Tashev%2C+Ivan+J&rft.date=2020-01-12&rft.pub=Cornell+University+Library%2C+arXiv.org&rft.eissn=2331-8422 |