Automatic Detection of Emotional Changes Induced by Social Support Loss Using fMRI

We propose using fMRI to study emotional changes related to social-support. In this respect, a Social Support fMRI task, which triggers emotional changes was designed and implemented. The detection of emotional changes from fMRI signals has significant importance in understanding the underlying mech...

Full description

Saved in:
Bibliographic Details
Published inIEEE transactions on affective computing Vol. 14; no. 1; pp. 706 - 717
Main Authors Candemir, Cemre, Gonul, Ali Saffet, Selver, M. Alper
Format Journal Article
LanguageEnglish
Published Piscataway IEEE 01.01.2023
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects
Online AccessGet full text

Cover

Loading…
Abstract We propose using fMRI to study emotional changes related to social-support. In this respect, a Social Support fMRI task, which triggers emotional changes was designed and implemented. The detection of emotional changes from fMRI signals has significant importance in understanding the underlying mechanisms of social-support. Unfortunately, acquired signals exhibit a very low signal-to-noise ratio and strong inter-subject variations, which render the detection process a very challenging task. For this purpose, a three-phase detection system is designed. First, possible emotional change intervals are classified to isolate trivial samples and further process the challenging ones. Second, a new denoising strategy is proposed to preserve the structural waveform properties of the emotional changes, while removing noise. Third, fMRI signals are synthesized using trapezoidal modeling and a novel feature set is extracted to characterize the varying social-support levels. The analysis shows that emotional changes can be detected automatically up to a requisite level. Despite the results cannot be generalized for the entire population due to its small sample size, our findings are meaningful and suggest further research with larger datasets. The introduced task may enable further research and the proposed system may be used as a tool for social neuroscience studies.
AbstractList We propose using fMRI to study emotional changes related to social-support. In this respect, a Social Support fMRI task, which triggers emotional changes was designed and implemented. The detection of emotional changes from fMRI signals has significant importance in understanding the underlying mechanisms of social-support. Unfortunately, acquired signals exhibit a very low signal-to-noise ratio and strong inter-subject variations, which render the detection process a very challenging task. For this purpose, a three-phase detection system is designed. First, possible emotional change intervals are classified to isolate trivial samples and further process the challenging ones. Second, a new denoising strategy is proposed to preserve the structural waveform properties of the emotional changes, while removing noise. Third, fMRI signals are synthesized using trapezoidal modeling and a novel feature set is extracted to characterize the varying social-support levels. The analysis shows that emotional changes can be detected automatically up to a requisite level. Despite the results cannot be generalized for the entire population due to its small sample size, our findings are meaningful and suggest further research with larger datasets. The introduced task may enable further research and the proposed system may be used as a tool for social neuroscience studies.
Author Selver, M. Alper
Gonul, Ali Saffet
Candemir, Cemre
Author_xml – sequence: 1
  givenname: Cemre
  orcidid: 0000-0001-9850-137X
  surname: Candemir
  fullname: Candemir, Cemre
  email: cemre.candemir@gmail.com
  organization: International Computer Institute, Ege University, Izmir, Turkey
– sequence: 2
  givenname: Ali Saffet
  orcidid: 0000-0003-3522-1359
  surname: Gonul
  fullname: Gonul, Ali Saffet
  email: ali.saffet.gonul@socatlab.com
  organization: Department of Psychiatry, Medical Faculty, Ege University, Izmir, Turkey
– sequence: 3
  givenname: M. Alper
  orcidid: 0000-0002-8445-0388
  surname: Selver
  fullname: Selver, M. Alper
  email: aselver@gmail.com
  organization: Department of Electrical and Electronics Engineering and with BioIzmir, Izmir Health Technologies Development and Accelerator, Dokuz Eylul University, Izmir, Turkey
BookMark eNp9kMtOwzAQRS1UJErpD8DGEuuUsZ2HvaxCC5WKkPpYW05il1RtHGJn0b8noRVCLJjNjDT3jO7cWzSobKURuicwIQTE02Y6n6cTCpRMGERCxNEVGhIRioBBGA1-zTdo7NweumKMxTQZotW09faofJnjZ-117ktbYWvw7Gj7UR1w-qGqnXZ4URVtrgucnfDa5mW3Wbd1bRuPl9Y5vHVltcPmbbW4Q9dGHZweX_oIbeezTfoaLN9fFul0GeRURD4ghCjCDWRZzGKggmccQk4iFVKlQGkwggjDjM5DKMBkhBaEJzwxYGJNdcFG6PF8t27sZ6udl3vbNp1lJ2nCQXDGI-hU_KzKm85mo43MS6_633yjyoMkIPsQ5XeIsg9RXkLsUPoHrZvyqJrT_9DDGSq11j-AYFFMaMK-AMrcfgA
CODEN ITACBQ
CitedBy_id crossref_primary_10_3390_s23073382
crossref_primary_10_3390_s23135866
crossref_primary_10_1109_JBHI_2023_3265684
Cites_doi 10.1111/j.2517-6161.1996.tb02080.x
10.1016/j.cmpb.2017.12.021
10.1023/b:comh.0000040657.48759.0e
10.1016/j.conb.2013.01.006
10.1126/science.1089134
10.1007/978-1-4612-1694-0_16
10.1109/TAP.2016.2567438
10.1109/TAFFC.2017.2714671
10.1109/34.75512
10.1109/TVCG.2008.198
10.1177/1745691612469037
10.1109/TAFFC.2015.2411280
10.1109/TBME.2004.839630
10.1109/72.80341
10.1214/aos/1176344136
10.1007/s10597-004-6125-5
10.1109/TBME.2004.831525
10.1117/12.813436
10.1109/TMI.2007.908684
10.1109/42.913175
10.1109/TAFFC.2018.2792000
10.1109/TMI.2019.2915052
10.1109/TNN.2003.811355
10.1523/JNEUROSCI.21-16-j0002.2001
10.1109/MEMB.2006.1607665
10.1073/pnas.87.24.9868
10.1109/TNNLS.2012.2205018
10.1109/TSA.2005.860851
10.1037/xge0000287
10.1109/72.572101
10.1002/9781118914564
10.1016/j.neuroimage.2016.09.008
10.1109/T-AFFC.2012.16
10.1016/j.media.2020.101950
10.1016/bs.pbr.2017.08.005
10.1109/TSMCC.2009.2013816
10.1093/scan/nsl019
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2023
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2023
DBID 97E
RIA
RIE
AAYXX
CITATION
7SC
8FD
JQ2
L7M
L~C
L~D
DOI 10.1109/TAFFC.2021.3059965
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005-present
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Xplore
CrossRef
Computer and Information Systems Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
Computer and Information Systems Abstracts
Technology Research Database
Computer and Information Systems Abstracts – Academic
Advanced Technologies Database with Aerospace
ProQuest Computer Science Collection
Computer and Information Systems Abstracts Professional
DatabaseTitleList
Computer and Information Systems Abstracts
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Xplore
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISSN 1949-3045
EndPage 717
ExternalDocumentID 10_1109_TAFFC_2021_3059965
9356127
Genre orig-research
GrantInformation_xml – fundername: Türkiye Bilimsel ve Teknolojik Araştırma Kurumu; TUBITAK
  grantid: 116E133
  funderid: 10.13039/501100004410
GroupedDBID 0R~
4.4
5VS
6IK
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABJNI
ABQJQ
ABVLG
AENEX
AGQYO
AGSQL
AHBIQ
AKJIK
AKQYR
ALMA_UNASSIGNED_HOLDINGS
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
EBS
EJD
HZ~
IEDLZ
IFIPE
IPLJI
JAVBF
M43
O9-
OCL
PQQKQ
RIA
RIE
RNI
RZB
AAYXX
CITATION
7SC
8FD
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c295t-111a18f0bb6360298b804815a42aa0ae0f919f3fec40d0fb12d18787f0f6e2ed3
IEDL.DBID RIE
ISSN 1949-3045
IngestDate Mon Jun 30 04:41:09 EDT 2025
Tue Jul 01 02:57:53 EDT 2025
Thu Apr 24 23:11:42 EDT 2025
Wed Aug 27 02:14:19 EDT 2025
IsPeerReviewed true
IsScholarly true
Issue 1
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
https://doi.org/10.15223/policy-029
https://doi.org/10.15223/policy-037
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c295t-111a18f0bb6360298b804815a42aa0ae0f919f3fec40d0fb12d18787f0f6e2ed3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0002-8445-0388
0000-0001-9850-137X
0000-0003-3522-1359
PQID 2780983850
PQPubID 2040414
PageCount 12
ParticipantIDs proquest_journals_2780983850
crossref_citationtrail_10_1109_TAFFC_2021_3059965
ieee_primary_9356127
crossref_primary_10_1109_TAFFC_2021_3059965
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2023-Jan.-March-1
2023-1-1
20230101
PublicationDateYYYYMMDD 2023-01-01
PublicationDate_xml – month: 01
  year: 2023
  text: 2023-Jan.-March-1
PublicationDecade 2020
PublicationPlace Piscataway
PublicationPlace_xml – name: Piscataway
PublicationTitle IEEE transactions on affective computing
PublicationTitleAbbrev TAFFC
PublicationYear 2023
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref13
ref35
ref12
ref34
ref15
ref37
ref14
ref36
ref31
ref30
ref11
ref33
ref10
ref32
ref1
Smith (ref2) 2008
ref17
ref39
ref16
ref38
ref19
ref18
ref24
ref23
ref26
ref25
ref20
ref22
ref21
Candemir (ref7) 2018
ref28
ref27
ref29
ref8
ref9
ref4
ref3
ref6
ref5
References_xml – ident: ref22
  doi: 10.1111/j.2517-6161.1996.tb02080.x
– ident: ref10
  doi: 10.1016/j.cmpb.2017.12.021
– ident: ref17
  doi: 10.1023/b:comh.0000040657.48759.0e
– ident: ref18
  doi: 10.1016/j.conb.2013.01.006
– ident: ref39
  doi: 10.1126/science.1089134
– ident: ref23
  doi: 10.1007/978-1-4612-1694-0_16
– ident: ref20
  doi: 10.1109/TAP.2016.2567438
– ident: ref37
  doi: 10.1109/TAFFC.2017.2714671
– ident: ref26
  doi: 10.1109/34.75512
– ident: ref31
  doi: 10.1109/TVCG.2008.198
– ident: ref35
  doi: 10.1177/1745691612469037
– ident: ref6
  doi: 10.1109/TAFFC.2015.2411280
– ident: ref19
  doi: 10.1109/TBME.2004.839630
– ident: ref15
  doi: 10.1109/72.80341
– ident: ref24
  doi: 10.1214/aos/1176344136
– ident: ref16
  doi: 10.1007/s10597-004-6125-5
– ident: ref28
  doi: 10.1109/TBME.2004.831525
– ident: ref27
  doi: 10.1117/12.813436
– ident: ref21
  doi: 10.1109/TMI.2007.908684
– ident: ref9
  doi: 10.1109/42.913175
– ident: ref34
  doi: 10.1109/TAFFC.2018.2792000
– ident: ref8
  doi: 10.1109/TMI.2019.2915052
– ident: ref14
  doi: 10.1109/TNN.2003.811355
– ident: ref12
  doi: 10.1523/JNEUROSCI.21-16-j0002.2001
– ident: ref3
  doi: 10.1109/MEMB.2006.1607665
– ident: ref4
  doi: 10.1073/pnas.87.24.9868
– year: 2018
  ident: ref7
  article-title: “Change point estimation in multi subject social support fMRI studies,”
– ident: ref30
  doi: 10.1109/TNNLS.2012.2205018
– ident: ref33
  doi: 10.1109/TSA.2005.860851
– ident: ref1
  doi: 10.1037/xge0000287
– ident: ref13
  doi: 10.1109/72.572101
– ident: ref29
  doi: 10.1002/9781118914564
– ident: ref36
  doi: 10.1016/j.neuroimage.2016.09.008
– ident: ref38
  doi: 10.1109/T-AFFC.2012.16
– start-page: 428
  volume-title: Handbook of Emotions
  year: 2008
  ident: ref2
  article-title: “Intergroup emotions
– ident: ref5
  doi: 10.1016/j.media.2020.101950
– ident: ref11
  doi: 10.1016/bs.pbr.2017.08.005
– ident: ref32
  doi: 10.1109/TSMCC.2009.2013816
– ident: ref25
  doi: 10.1093/scan/nsl019
SSID ssj0000333627
Score 2.3182693
Snippet We propose using fMRI to study emotional changes related to social-support. In this respect, a Social Support fMRI task, which triggers emotional changes was...
SourceID proquest
crossref
ieee
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 706
SubjectTerms BOLD signal denoising
change point detection (CPD)
emotional change (EC)
Feature extraction
fMRI
Functional magnetic resonance imaging
Games
Shape
Signal processing
Signal to noise ratio
social support
Task analysis
Transient analysis
Waveforms
Title Automatic Detection of Emotional Changes Induced by Social Support Loss Using fMRI
URI https://ieeexplore.ieee.org/document/9356127
https://www.proquest.com/docview/2780983850
Volume 14
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV07T8MwED6VTiwUKIhCQR7YIKkfedhjVVoVRBmqVuoWOYm9gFpE0wF-PbbzkHgIsWWwLefOPt_Zd98HcM2JjAOehR6hOvKCPBYe15x5VHEWKK5oLO2L7uwpmi6Dh1W4asFtUwujlHLJZ8q3n-4tP99kO3tVNhDMcjnGe7BnAreyVqu5T8GMGVsc13UxWAwWw8lkZCJASnzmUEjCL2ePI1P5YYHdsTLpwKyeUJlN8uzvitTPPr5hNf53xodwUPmXaFguiCNoqfUxdGruBlRt5S7Mh7ti4-Ba0Z0qXD7WGm00Gpe0PmaIsu5giyy5R6ZylL6jspYXWSZQ47WjR_OTyOUcID2b35_AcjJejKZexa_gZVSEhWfMnCRc4zS1oGFU8JQ79BgZUCmxVFgLIjTTKgtwjnVKaE642eAa60hRlbNTaK83a3UGKDISzwIiODWNZURliPOcRyKSYWoiItIDUks-ySrwccuB8ZK4IASLxGkrsdpKKm314Kbp81pCb_zZumvF37SsJN-Dfq3gpNqd24TGHAvOeIjPf-91AfuWVr68aulDu3jbqUvjfBTplVt1n7mV1Ks
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV07T8MwED7xGGDhVRCFAh7YIMWPPOyxglYttB2qVuoWOYm9gBpE0wF-PbaTVOIhxJbhbDl3vvPr7vsArjmRkc_TwCNUh56fRcLjmjOPKs58xRWNpH3RHY3D_sx_nAfzDbhd18IopVzymWrbT_eWn-Xpyl6V3QlmuRyjTdg2635Aymqt9Y0KZsxE46iujMHibtrp9e7NGZCSNnM4JMGX1cfRqfyIwW5h6e3DqB5SmU_y3F4VSTv9-IbW-N8xH8BetcNEnXJKHMKGWhzBfs3egCpnbsCksypyB9iKHlThMrIWKNeoWxL7mC7KyoMlsvQeqcpQ8o7Kal5kuUDNvh0NzU8il3WA9GgyOIZZrzu973sVw4KXUhEUngl0knCNk8TChlHBE-7wY6RPpcRSYS2I0Eyr1McZ1gmhGeHGxTXWoaIqYyewtcgX6hRQaDSe-kRwaoRlSGWAs4yHIpRBYs5EpAmk1nycVvDjlgXjJXbHECxiZ63YWiuurNWEm3Wb1xJ840_phlX_WrLSfBNatYHjyj-XMY04FpzxAJ_93uoKdvrT0TAeDsZP57BrSebLi5cWbBVvK3VhtiJFculm4Cf8vNf0
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Automatic+Detection+of+Emotional+Changes+Induced+by+Social+Support+Loss+Using+fMRI&rft.jtitle=IEEE+transactions+on+affective+computing&rft.au=Candemir%2C+Cemre&rft.au=Gonul%2C+Ali+Saffet&rft.au=Selver%2C+M.+Alper&rft.date=2023-01-01&rft.pub=IEEE&rft.eissn=1949-3045&rft.volume=14&rft.issue=1&rft.spage=706&rft.epage=717&rft_id=info:doi/10.1109%2FTAFFC.2021.3059965&rft.externalDocID=9356127
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1949-3045&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1949-3045&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1949-3045&client=summon