Brain's Night Symphony (BraiNSy): A Methodology for EEG Sonification
This paper describes a method for converting sleep Electroencephalogram (EEG) signals into music. For that purpose, a new segmentation procedure is used for extracting relevant information from the sleep EEG that is then translated into sequences of notes, chords, arpeggios and pauses, with a varyin...
Saved in:
| Published in | IEEE transactions on affective computing Vol. 12; no. 1; pp. 103 - 112 |
|---|---|
| Main Authors | , , |
| Format | Journal Article |
| Language | English |
| Published |
Piscataway
IEEE
01.01.2021
The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Subjects | |
| Online Access | Get full text |
| ISSN | 1949-3045 1949-3045 |
| DOI | 10.1109/TAFFC.2018.2850008 |
Cover
Loading…
| Abstract | This paper describes a method for converting sleep Electroencephalogram (EEG) signals into music. For that purpose, a new segmentation procedure is used for extracting relevant information from the sleep EEG that is then translated into sequences of notes, chords, arpeggios and pauses, with a varying tempo that is defined by sleep stages. The final outcome is a direct time-domain conversion of the brain activity during sleep into sound. Since typical sleep EEGs vary with age and sleep disorders, different groups of subjects were used in the experiments: babies, sane adults and patients with air-flow limitation. |
|---|---|
| AbstractList | This paper describes a method for converting sleep Electroencephalogram (EEG) signals into music. For that purpose, a new segmentation procedure is used for extracting relevant information from the sleep EEG that is then translated into sequences of notes, chords, arpeggios and pauses, with a varying tempo that is defined by sleep stages. The final outcome is a direct time-domain conversion of the brain activity during sleep into sound. Since typical sleep EEGs vary with age and sleep disorders, different groups of subjects were used in the experiments: babies, sane adults and patients with air-flow limitation. |
| Author | Rosa, Agostinho C. Fernandes, Carlos M. Migotina, Daria |
| Author_xml | – sequence: 1 givenname: Carlos M. orcidid: 0000-0002-1594-6785 surname: Fernandes fullname: Fernandes, Carlos M. email: cfernandes@laseeb.org organization: University of Lisbon, Lisbon, Portugal – sequence: 2 givenname: Daria orcidid: 0000-0003-0182-6907 surname: Migotina fullname: Migotina, Daria email: dmigotina@laseeb.org organization: University of Lisbon, Lisbon, Portugal – sequence: 3 givenname: Agostinho C. orcidid: 0000-0001-5165-3114 surname: Rosa fullname: Rosa, Agostinho C. email: acrosa@laseeb.org organization: University of Lisbon, Lisbon, Portugal |
| BookMark | eNp9kE1PAjEQhhuDiYj8Ab008aAeFqftfrTeEAFNEA_gudnttlACW-wuh_33Lh8xxoOnmUzeZybzXKJW4QqN0DWBHiEgHuf90WjQo0B4j_IIAPgZahMRioBBGLV-9ReoW5arJgGMsZgmbfTy7FNb3JV4ahfLCs_qzXbpihrf7-fTWf3whPv4XVdLl7u1W9TYOI-HwzGeucIaq9LKuuIKnZt0XeruqXbQ52g4H7wGk4_x26A_CRQVURXkimdgeG5SqgGy1BhFYsgyChxoEkax4TRJWU4ynYASjPAkzHIAEitIOQtZB90e9269-9rpspIrt_NFc1LSUISMCxbHTYoeU8q7svTayK23m9TXkoDcC5MHYXIvTJ6ENRD_AylbHZ6rGhHr_9GbI2q11j-3OBMRMMG-AbhaeBs |
| CODEN | ITACBQ |
| CitedBy_id | crossref_primary_10_1016_j_heliyon_2024_e41147 crossref_primary_10_3390_app122111209 crossref_primary_10_1109_JIOT_2021_3083745 crossref_primary_10_1002_bit_28729 |
| Cites_doi | 10.1073/pnas.87.3.938 10.1016/j.sleep.2004.07.010 10.1038/310096a0 10.1093/brain/57.4.355 10.1007/978-3-642-34156-4_36 10.1142/S0129065713500123 10.1080/00150517.1964.12431497 10.1371/journal.pone.0005915 10.1093/oso/9780195131581.001.0001 10.1162/014892603322022682 10.1145/3106548.3106614 10.1109/ISWC.1997.629932 10.1162/014892600559335 10.1038/41277 10.1109/MMUL.2005.36 10.2307/854000 10.2307/3128798 10.1080/09298219208570604 10.1038/20833 10.1073/pnas.88.8.3507 10.1504/IJART.2015.069553 10.1162/0024094054762133 10.1142/9789812832054_0008 10.1016/j.clinph.2007.01.025 10.2307/3680116 10.1142/S0129065712500025 10.1038/258317a0 10.1093/mq/LIX.1.92 10.2316/P.2012.764-063 10.1162/LEON_a_00180 |
| ContentType | Journal Article |
| Copyright | Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021 |
| Copyright_xml | – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021 |
| DBID | 97E RIA RIE AAYXX CITATION 7SC 8FD JQ2 L7M L~C L~D |
| DOI | 10.1109/TAFFC.2018.2850008 |
| DatabaseName | IEEE All-Society Periodicals Package (ASPP) 2005–Present IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Electronic Library (IEL) CrossRef Computer and Information Systems Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional |
| DatabaseTitle | CrossRef Computer and Information Systems Abstracts Technology Research Database Computer and Information Systems Abstracts – Academic Advanced Technologies Database with Aerospace ProQuest Computer Science Collection Computer and Information Systems Abstracts Professional |
| DatabaseTitleList | Computer and Information Systems Abstracts |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Music Computer Science |
| EISSN | 1949-3045 |
| EndPage | 112 |
| ExternalDocumentID | 10_1109_TAFFC_2018_2850008 8395039 |
| Genre | orig-research |
| GrantInformation_xml | – fundername: Fundacao para a Ciencia e Tecnologia grantid: SFRH/BPD/111065/2015; UID/EEA/50009/2013 |
| GroupedDBID | 0R~ 4.4 5VS 6IK 97E AAJGR AARMG AASAJ AAWTH ABAZT ABJNI ABQJQ ABVLG AENEX AGQYO AGSQL AHBIQ AKJIK AKQYR ALMA_UNASSIGNED_HOLDINGS ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ EBS EJD HZ~ IEDLZ IFIPE IPLJI JAVBF M43 O9- OCL PQQKQ RIA RIE RNI RZB AAYXX CITATION 7SC 8FD JQ2 L7M L~C L~D |
| ID | FETCH-LOGICAL-c295t-dc8b0f8dfa2e00baffc160bb208027456f827a3d1be70c931874bd0016c0a8343 |
| IEDL.DBID | RIE |
| ISSN | 1949-3045 |
| IngestDate | Sun Jun 29 15:27:39 EDT 2025 Thu Apr 24 22:59:19 EDT 2025 Thu Jul 10 08:08:30 EDT 2025 Wed Aug 27 02:48:01 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 1 |
| Language | English |
| License | https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html https://doi.org/10.15223/policy-029 https://doi.org/10.15223/policy-037 |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c295t-dc8b0f8dfa2e00baffc160bb208027456f827a3d1be70c931874bd0016c0a8343 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
| ORCID | 0000-0002-1594-6785 0000-0003-0182-6907 0000-0001-5165-3114 |
| PQID | 2494389366 |
| PQPubID | 2040414 |
| PageCount | 10 |
| ParticipantIDs | proquest_journals_2494389366 ieee_primary_8395039 crossref_citationtrail_10_1109_TAFFC_2018_2850008 crossref_primary_10_1109_TAFFC_2018_2850008 |
| PublicationCentury | 2000 |
| PublicationDate | 2021-Jan.-March-1 2021-1-1 20210101 |
| PublicationDateYYYYMMDD | 2021-01-01 |
| PublicationDate_xml | – month: 01 year: 2021 text: 2021-Jan.-March-1 |
| PublicationDecade | 2020 |
| PublicationPlace | Piscataway |
| PublicationPlace_xml | – name: Piscataway |
| PublicationTitle | IEEE transactions on affective computing |
| PublicationTitleAbbrev | T-AFFC |
| PublicationYear | 2021 |
| Publisher | IEEE The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Publisher_xml | – name: IEEE – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| References | ref13 herremans (ref18) 2017 norden (ref35) 1964; 2 lucier (ref25) 1976 ref11 ref16 ref19 mcdonald (ref26) 2007 franco (ref12) 2015; 7 frysinger (ref14) 0 ref50 ref46 ref45 ref48 ref47 ref42 ref44 migotina (ref29) 2012 fernandes (ref9) 0 ref49 ref8 ref7 ref4 ref6 teitelbaum (ref43) 1976 ref40 sachs (ref27) 1953 ref34 ref37 ref36 ref31 ref30 rechtschaffen (ref38) 1968 ref33 ref2 ref1 axen (ref3) 0 fernandes (ref10) 2014; 44 riley (ref39) 2008 miranda (ref32) 0 ref23 ref20 ref22 gevins (ref15) 1987 swierzewski (ref41) 2008 heckroth (ref17) 1995 ref28 hjorth (ref21) 1975 iber (ref24) 2007 benward (ref5) 2009; 1 |
| References_xml | – ident: ref22 doi: 10.1073/pnas.87.3.938 – volume: 44 start-page: 843 year: 2014 ident: ref10 article-title: KANTS: A stigmergic algorithm for clustering and swarm art publication-title: IEEE Trans Syst Man Cybern - B – year: 2008 ident: ref39 publication-title: Audio Editing with Adobe Audition – ident: ref36 doi: 10.1016/j.sleep.2004.07.010 – year: 2007 ident: ref26 publication-title: Pro ASP NET 2 0 in C# 2005 Special Edition – ident: ref16 doi: 10.1038/310096a0 – ident: ref2 doi: 10.1093/brain/57.4.355 – start-page: 72 year: 0 ident: ref9 article-title: Pherogenic drawings: Generating colored 2-dimensional abstract representations of sleep EEG with the KANTS clustering algorithm publication-title: Proc 4th Int Conf Evol Comput Theory Practice – ident: ref44 doi: 10.1007/978-3-642-34156-4_36 – year: 1968 ident: ref38 article-title: A manual of standardized terminology, techniques and scoring system for sleep stages of human subjects – ident: ref19 doi: 10.1142/S0129065713500123 – volume: 2 start-page: 219 year: 1964 ident: ref35 article-title: Proportions in music publication-title: Fibonacci Quarterly doi: 10.1080/00150517.1964.12431497 – ident: ref50 doi: 10.1371/journal.pone.0005915 – ident: ref6 doi: 10.1093/oso/9780195131581.001.0001 – ident: ref30 doi: 10.1162/014892603322022682 – start-page: 295 year: 0 ident: ref32 article-title: Brain-computer music interface for generative music publication-title: Proc 6th Int Conf Disability – ident: ref11 doi: 10.1145/3106548.3106614 – year: 1953 ident: ref27 publication-title: Rhythm and Tempo A Study in Music History – ident: ref13 doi: 10.1109/ISWC.1997.629932 – year: 1976 ident: ref25 article-title: Statement on: Music for solo performer publication-title: Biofeedback and the Arts Results of Early Experiments – ident: ref7 doi: 10.1162/014892600559335 – ident: ref37 doi: 10.1038/41277 – ident: ref20 doi: 10.1109/MMUL.2005.36 – ident: ref45 doi: 10.2307/854000 – ident: ref49 doi: 10.2307/3128798 – ident: ref34 doi: 10.1080/09298219208570604 – start-page: 3 year: 1975 ident: ref21 article-title: Time domain descriptors and their relation to a particular model for generation of eeg activity publication-title: Proc CEAN -Comput EEG Anal – volume: 1 year: 2009 ident: ref5 publication-title: Music in Theory and Practice – year: 2007 ident: ref24 article-title: The AASM manual for the scoring of sleep and associated events: Rules, terminology and technical specifications – ident: ref42 doi: 10.1038/20833 – year: 1976 ident: ref43 article-title: In tune: Some early experiments on biofeedback music (1966-1974) publication-title: Biofeedback and the Arts Results of Early Experiments – year: 0 ident: ref3 article-title: Investigating geometric data with sound publication-title: Proc Int Conf Auditory Display – year: 1987 ident: ref15 publication-title: Handbook of Electroencephalography and Clinical Neurophysiology Vol I Methods of Analysis of Brain Electrical and Magnetic Signals – ident: ref23 doi: 10.1073/pnas.88.8.3507 – year: 2017 ident: ref18 article-title: MorpheuS: Generating structured music with constrained patterns and tension publication-title: IEEE Trans Affect Comput – ident: ref8 doi: 10.1504/IJART.2015.069553 – ident: ref31 doi: 10.1162/0024094054762133 – year: 2008 ident: ref41 article-title: Sleep stages, overview, waking, Non-REM, REM, sleep cycle, factors, age publication-title: Sleep Channel – ident: ref33 doi: 10.1142/9789812832054_0008 – year: 1995 ident: ref17 article-title: Tutorial on MIDI and music synthesis. The MIDI manufacturers association – ident: ref4 doi: 10.1016/j.clinph.2007.01.025 – year: 2012 ident: ref29 article-title: Symbolic representation of the sleep electroencephalogram. Application in the analysis of sleep – ident: ref40 doi: 10.2307/3680116 – ident: ref1 doi: 10.1142/S0129065712500025 – ident: ref46 doi: 10.1038/258317a0 – start-page: 130 year: 0 ident: ref14 article-title: Applied research in auditory data representation publication-title: Proc Soc Photo-Optical Instrum Eng (Extracting Meaning Complex Data Process Display Interaction) – ident: ref48 doi: 10.1093/mq/LIX.1.92 – ident: ref28 doi: 10.2316/P.2012.764-063 – volume: 7 start-page: 65 year: 2015 ident: ref12 article-title: Experiments of the sonification of the sleep electroencephalogram publication-title: Finnish Journal of EHealth and EWelfare – ident: ref47 doi: 10.1162/LEON_a_00180 |
| SSID | ssj0000333627 |
| Score | 2.2423124 |
| Snippet | This paper describes a method for converting sleep Electroencephalogram (EEG) signals into music. For that purpose, a new segmentation procedure is used for... |
| SourceID | proquest crossref ieee |
| SourceType | Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 103 |
| SubjectTerms | Air flow Babies Brain Electroencephalography Feature extraction Frequency modulation generative art Multiple signal classification Music Segmentation signal processing Sleep sleep EEG Sonification |
| Title | Brain's Night Symphony (BraiNSy): A Methodology for EEG Sonification |
| URI | https://ieeexplore.ieee.org/document/8395039 https://www.proquest.com/docview/2494389366 |
| Volume | 12 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LTwIxEJ4AXryIokYUTQ8manSh2y7drjdEkJjABU28bbaviwpG4IC_3rbskviI8bZp2qTptDPfzM7MB3CqrTbURPIgDgkLIuswBzxSJsiIxd4ZF6FWrhp5OGKDx-j-qf1Ugqt1LYzW2ief6ab79P_y1VQuXKisZY15G9OkDGXruK1qtdbxFEyp1cVxUReDk9ZDp9_vuuQt3iTc9f3nX2yPJ1P5oYG9WelXYVhsaJVN8txczEVTfnzr1fjfHW_DVo4vUWd1IXagpCc1qBbcDSh_yjXY8ATPu3B74zgizmZo5Lx0NF6--mR1dO7GR-PlxTXqoKGnmfYBeGRBLur17tDYKgOTB_z24LHfe-gOgpxZIZAkac8DJbnAhiuTEY2xyIyRIcNCEFd5G1tMZTiJM6pCoWMsE-qI-4Ry8FDijNOI7kNlMp3oA0CKEcU1YcrIKEpUnFkXR5M2ZVlskYNhdQiLM09l3nbcsV-8pN79wEnq5ZQ6OaW5nOpwuV7ztmq68efsXXfw65n5mdehUYg2zd_lLLXOpqN7p4wd_r7qCDaJy1rxQZYGVObvC31sYcdcnPj79gmuFdGN |
| linkProvider | IEEE |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LTwIxEJ6gHvTiAzXiswcTNbrQbZdu1xsqiA-4gIm3zfZ1UcEIHPTX25ZdEh8x3jZNmzSdduab2Zn5AA611YaaSB7EIWFBZB3mgEfKBBmx2DvjItTKVSN3uqz9EN0-1h9LcDarhdFa--QzXXWf_l--GsqJC5XVrDGvY5rMwYK1-1EyrdaaRVQwpVYbx0VlDE5q_UardenSt3iVcNf5n3-xPp5O5YcO9oaltQKdYkvTfJKn6mQsqvLjW7fG_-55FZZzhIka0yuxBiU9KMNKwd6A8sdchgVP8bwOVxeOJeJohLrOT0e99xefro6O3Xi3935yjhqo44mmfQgeWZiLms1r1LPqwOQhvw14aDX7l-0g51YIJEnq40BJLrDhymREYywyY2TIsBDE1d7GFlUZTuKMqlDoGMuEOuo-oRxAlDjjNKKbMD8YDvQWIMWI4powZWQUJSrOrJOjSZ2yLLbYwbAKhMWZpzJvPO74L55T74DgJPVySp2c0lxOFTidrXmdtt34c_a6O_jZzPzMK7BbiDbNX-Yote6mI3ynjG3_vuoAFtv9zn16f9O924El4nJYfMhlF-bHbxO9Z0HIWOz7u_cJ27rU3Q |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Brain%27s+Night+Symphony+%28BraiNSy%29%3A+A+Methodology+for+EEG+Sonification&rft.jtitle=IEEE+transactions+on+affective+computing&rft.au=Fernandes%2C+Carlos+M.&rft.au=Migotina%2C+Daria&rft.au=Rosa%2C+Agostinho+C.&rft.date=2021-01-01&rft.issn=1949-3045&rft.eissn=1949-3045&rft.volume=12&rft.issue=1&rft.spage=103&rft.epage=112&rft_id=info:doi/10.1109%2FTAFFC.2018.2850008&rft.externalDBID=n%2Fa&rft.externalDocID=10_1109_TAFFC_2018_2850008 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1949-3045&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1949-3045&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1949-3045&client=summon |