Cross-cultural detection of depression from nonverbal behaviour

Millions of people worldwide suffer from depression. Do commonalities exist in their nonverbal behavior that would enable cross-culturally viable screening and assessment of severity? We investigated the generalisability of an approach to detect depression severity cross-culturally using video-recor...

Full description

Saved in:
Bibliographic Details
Published in2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) Vol. 1; pp. 1 - 8
Main Authors Alghowinem, Sharifa, Goecke, Roland, Cohn, Jeffrey F., Wagner, Michael, Parker, Gordon, Breakspear, Michael
Format Conference Proceeding Journal Article
LanguageEnglish
Published United States IEEE 01.05.2015
Subjects
Online AccessGet full text

Cover

Loading…
Abstract Millions of people worldwide suffer from depression. Do commonalities exist in their nonverbal behavior that would enable cross-culturally viable screening and assessment of severity? We investigated the generalisability of an approach to detect depression severity cross-culturally using video-recorded clinical interviews from Australia, the USA and Germany. The material varied in type of interview, subtypes of depression and inclusion healthy control subjects, cultural background, and recording environment. The analysis focussed on temporal features of participants' eye gaze and head pose. Several approaches to training and testing within and between datasets were evaluated. The strongest results were found for training across all datasets and testing across datasets using leave-one-subject-out cross-validation. In contrast, generalisability was attenuated when training on only one or two of the three datasets and testing on subjects from the dataset(s) not used in training. These findings highlight the importance of using training data exhibiting the expected range of variability.
AbstractList Millions of people worldwide suffer from depression. Do commonalities exist in their nonverbal behavior that would enable cross-culturally viable screening and assessment of severity? We investigated the generalisability of an approach to detect depression severity cross-culturally using video-recorded clinical interviews from Australia, the USA and Germany. The material varied in type of interview, subtypes of depression and inclusion healthy control subjects, cultural background, and recording environment. The analysis focussed on temporal features of participants‘ eye gaze and head pose. Several approaches to training and testing within and between datasets were evaluated. The strongest results were found for training across all datasets and testing across datasets using leave-one-subject-out cross-validation. In contrast, generalisability was attenuated when training on only one or two of the three datasets and testing on subjects from the dataset(s) not used in training. These findings highlight the importance of using training data exhibiting the expected range of variability.
Millions of people worldwide suffer from depression. Do commonalities exist in their nonverbal behavior that would enable cross-culturally viable screening and assessment of severity? We investigated the generalisability of an approach to detect depression severity cross-culturally using video-recorded clinical interviews from Australia, the USA and Germany. The material varied in type of interview, subtypes of depression and inclusion healthy control subjects, cultural background, and recording environment. The analysis focussed on temporal features of participants' eye gaze and head pose. Several approaches to training and testing within and between datasets were evaluated. The strongest results were found for training across all datasets and testing across datasets using leave-one-subject-out cross-validation. In contrast, generalisability was attenuated when training on only one or two of the three datasets and testing on subjects from the dataset(s) not used in training. These findings highlight the importance of using training data exhibiting the expected range of variability.Millions of people worldwide suffer from depression. Do commonalities exist in their nonverbal behavior that would enable cross-culturally viable screening and assessment of severity? We investigated the generalisability of an approach to detect depression severity cross-culturally using video-recorded clinical interviews from Australia, the USA and Germany. The material varied in type of interview, subtypes of depression and inclusion healthy control subjects, cultural background, and recording environment. The analysis focussed on temporal features of participants' eye gaze and head pose. Several approaches to training and testing within and between datasets were evaluated. The strongest results were found for training across all datasets and testing across datasets using leave-one-subject-out cross-validation. In contrast, generalisability was attenuated when training on only one or two of the three datasets and testing on subjects from the dataset(s) not used in training. These findings highlight the importance of using training data exhibiting the expected range of variability.
Author Alghowinem, Sharifa
Cohn, Jeffrey F.
Wagner, Michael
Parker, Gordon
Breakspear, Michael
Goecke, Roland
AuthorAffiliation 7 Ministry of Higher Education: Kingdom of Saudi Arabia
2 University of Canberra, Human-Centred Computing Laboratory, Canberra, Australia
6 Queensland Institute of Medical Research, Brisbane, Australia
4 Carnegie Mellon University, Computer Science at the Robotics Institute, Pittsburgh, PA, USA
5 University of New South Wales, Sydney, Australia
3 University of Pittsburgh, Pittsburgh, PA, USA
1 Australian National University, Research School of Computer Science, Canberra, Australia
AuthorAffiliation_xml – name: 5 University of New South Wales, Sydney, Australia
– name: 6 Queensland Institute of Medical Research, Brisbane, Australia
– name: 7 Ministry of Higher Education: Kingdom of Saudi Arabia
– name: 2 University of Canberra, Human-Centred Computing Laboratory, Canberra, Australia
– name: 1 Australian National University, Research School of Computer Science, Canberra, Australia
– name: 3 University of Pittsburgh, Pittsburgh, PA, USA
– name: 4 Carnegie Mellon University, Computer Science at the Robotics Institute, Pittsburgh, PA, USA
Author_xml – sequence: 1
  givenname: Sharifa
  surname: Alghowinem
  fullname: Alghowinem, Sharifa
  organization: Res. Sch. of Comput. Sci., Australian Nat. Univ., Canberra, ACT, Australia
– sequence: 2
  givenname: Roland
  surname: Goecke
  fullname: Goecke, Roland
  organization: Human-Centred Comput. Lab., Univ. of Canberra, Canberra, ACT, Australia
– sequence: 3
  givenname: Jeffrey F.
  surname: Cohn
  fullname: Cohn, Jeffrey F.
  organization: Univ. of Pittsburgh, Pittsburgh, PA, USA
– sequence: 4
  givenname: Michael
  surname: Wagner
  fullname: Wagner, Michael
  organization: Human-Centred Comput. Lab., Univ. of Canberra, Canberra, ACT, Australia
– sequence: 5
  givenname: Gordon
  surname: Parker
  fullname: Parker, Gordon
  organization: Univ. of New South Wales, Sydney, NSW, Australia
– sequence: 6
  givenname: Michael
  surname: Breakspear
  fullname: Breakspear, Michael
  organization: Queensland Inst. of Med. Res., Brisbane, QLD, Australia
BackLink https://www.ncbi.nlm.nih.gov/pubmed/27453895$$D View this record in MEDLINE/PubMed
BookMark eNpVkU1LAzEQhqNUbK09exCkRy9b853NRZFiq1Dwoucl2U5sYHdTs7sF_72B1lJPM8M8887LzBUaNKEBhG4InhGC9cNiOaOYiJkikhHCztBEq5xwpbXEVNJzNKKMykwwLQcn-RBN2tbbhCjJFeaXaEgVFyzXYoSe5jG0bVb2VddHU03X0EHZ-dBMg0vFNkKaTZWLoZ4mPzuINmEWNmbnQx-v0YUzVQuTQxyjz8XLx_w1W70v3-bPq8wnqyLTzjrGuOIWGy0VYUyBdqIUNCfOGYqxtUpQZTTkgJ0RNjeOrwkxBFuFHRujx73utrc1rEtoumS32EZfm_hTBOOL_53Gb4qvsCu4FkJSlgTuDwIxfPfQdkXt2xKqyjQQ-rYgORMy1-nACb073XVc8ne1BNzuAQ8Ax_bhLewXGg9-Ng
ContentType Conference Proceeding
Journal Article
DBID 6IE
6IL
CBEJK
RIE
RIL
NPM
7X8
5PM
DOI 10.1109/FG.2015.7163113
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Xplore POP ALL
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
PubMed
MEDLINE - Academic
PubMed Central (Full Participant titles)
DatabaseTitle PubMed
MEDLINE - Academic
DatabaseTitleList

PubMed
MEDLINE - Academic
Database_xml – sequence: 1
  dbid: NPM
  name: PubMed
  url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 2
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Applied Sciences
EISBN 9781479960262
1479960268
EISSN 2326-5396
EndPage 8
ExternalDocumentID PMC4955623
27453895
7163113
Genre orig-research
Journal Article
GrantInformation_xml – fundername: NIMH NIH HHS
  grantid: R01 MH096951
GroupedDBID 6IE
6IL
ALMA_UNASSIGNED_HOLDINGS
CBEJK
RIB
RIC
RIE
RIL
6IF
6IK
6IN
AAJGR
ABLEC
ADZIZ
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CHZPO
IEGSK
IPLJI
NPM
OCL
RNS
7X8
5PM
ID FETCH-LOGICAL-i3115-9fbf33474b0a9671337e9f5c5281ffa200bb7527a9e8e0fa5b8af4d11a10b70f3
IEDL.DBID RIE
ISSN 2326-5396
IngestDate Thu Aug 21 14:27:59 EDT 2025
Fri Jul 11 04:44:08 EDT 2025
Thu Jan 02 22:32:42 EST 2025
Wed Dec 20 05:19:31 EST 2023
IsDoiOpenAccess false
IsOpenAccess true
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i3115-9fbf33474b0a9671337e9f5c5281ffa200bb7527a9e8e0fa5b8af4d11a10b70f3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
OpenAccessLink https://www.ncbi.nlm.nih.gov/pmc/articles/4955623
PMID 27453895
PQID 1835689201
PQPubID 23479
PageCount 8
ParticipantIDs pubmedcentral_primary_oai_pubmedcentral_nih_gov_4955623
pubmed_primary_27453895
ieee_primary_7163113
proquest_miscellaneous_1835689201
PublicationCentury 2000
PublicationDate 20150501
PublicationDateYYYYMMDD 2015-05-01
PublicationDate_xml – month: 5
  year: 2015
  text: 20150501
  day: 1
PublicationDecade 2010
PublicationPlace United States
PublicationPlace_xml – name: United States
PublicationTitle 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG)
PublicationTitleAbbrev FG
PublicationTitleAlternate IEEE Int Conf Autom Face Gesture Recognit Workshops
PublicationYear 2015
Publisher IEEE
Publisher_xml – name: IEEE
References 16477188 - J Nerv Ment Dis. 2006 Feb;194(2):106-13
12946886 - Biol Psychiatry. 2003 Sep 1;54(5):573-83
26985326 - IEEE Trans Affect Comput. 2013 Apr-Jun;4(2):142-150
19965012 - Conf Proc IEEE Eng Med Biol Soc. 2009;2009:3723-6
19029545 - IEEE Trans Pattern Anal Mach Intell. 2009 Jan;31(1):39-58
14399272 - J Neurol Neurosurg Psychiatry. 1960 Feb;23:56-62
10916253 - IEEE Trans Biomed Eng. 2000 Jul;47(7):829-37
15376501 - IEEE Trans Biomed Eng. 2004 Sep;51(9):1530-40
3562707 - Psychol Bull. 1987 Mar;101(2):259-82
8991972 - J Pers Assess. 1996 Dec;67(3):588-97
1105794 - Soc Sci Med. 1975 Jun;9(6):289-301
References_xml – reference: 19965012 - Conf Proc IEEE Eng Med Biol Soc. 2009;2009:3723-6
– reference: 26985326 - IEEE Trans Affect Comput. 2013 Apr-Jun;4(2):142-150
– reference: 1105794 - Soc Sci Med. 1975 Jun;9(6):289-301
– reference: 19029545 - IEEE Trans Pattern Anal Mach Intell. 2009 Jan;31(1):39-58
– reference: 14399272 - J Neurol Neurosurg Psychiatry. 1960 Feb;23:56-62
– reference: 12946886 - Biol Psychiatry. 2003 Sep 1;54(5):573-83
– reference: 8991972 - J Pers Assess. 1996 Dec;67(3):588-97
– reference: 10916253 - IEEE Trans Biomed Eng. 2000 Jul;47(7):829-37
– reference: 15376501 - IEEE Trans Biomed Eng. 2004 Sep;51(9):1530-40
– reference: 16477188 - J Nerv Ment Dis. 2006 Feb;194(2):106-13
– reference: 3562707 - Psychol Bull. 1987 Mar;101(2):259-82
SSID ssib026764704
ssj0003010133
Score 1.8182207
Snippet Millions of people worldwide suffer from depression. Do commonalities exist in their nonverbal behavior that would enable cross-culturally viable screening and...
SourceID pubmedcentral
proquest
pubmed
ieee
SourceType Open Access Repository
Aggregation Database
Index Database
Publisher
StartPage 1
SubjectTerms Australia
Feature extraction
Interviews
Magnetic heads
Support vector machines
Testing
Training
Title Cross-cultural detection of depression from nonverbal behaviour
URI https://ieeexplore.ieee.org/document/7163113
https://www.ncbi.nlm.nih.gov/pubmed/27453895
https://www.proquest.com/docview/1835689201
https://pubmed.ncbi.nlm.nih.gov/PMC4955623
Volume 1
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV07T8MwELZKJyZALVBeChIjaePEj2RiqCgVUhEDlbpFcXMnKqQUlWTh13POC1p1YItkOznnLvZd_N13jN1JoChBYOBiEHquSDm4BgS6acANchJdlbUOZy9qOhfPC7nosPs2FwYASvAZDO1leZafrpeF_VU2It8-4LZE7QEFblWuVmM7vtJKaE_U7D3ci0aTJ4vcksN6VF0-ZZ8nuQuI_LPDTI7YrJGtApZ8DIvcDJffO7SN_xX-mPV_c_mc13aXOmEdyHrsYWw3R7eh3XBSyEtIVuas0WnBsZljk0-czALTN4a61Tn9xabP5pPHt_HUrUspuCtLp-NGaDAIhBbGSyJlA1MNEcql9EOOmNCnYoyWvk4iCMHDRJowQdIcT7hntIfBKevS0-CcOQlGippUihTMgK8NGsFRBDQulRLkgPXs5OPPii0jruc9YLfNe4_Jgu2xRJLBuviKaVGRKoxIVwN2VumhHUwxM63IEd1Ub2mo7WDZsbdbstV7yZJNkZ_17S72i3PJDq1xVNDFK9bNNwVck3uRm5vSrn4AuYzSsw
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LT8MwDI6mcYAToA0YzyJxpFuzJk174jAxBmwTh03arWpWW0xIHRrthV-P03aFTTtwq5S4dWo3tpvPNmN3EihKEOja6PqOLWIOtgaBduxyjZxY9_Jeh6OxN5iKl5mc1dh9lQsDADn4DNrmMj_Lj5fzzPwq65Bv73LTonaP7L7kRbbWWnu6nvKEckRZv4c7Qaf_ZLBbsl3SlQ1UdvmS25DIPzamf8hGa-4KaMlHO0t1e_69Vbjxv-wfseZvNp_1VtmpY1aDpMEeesY82uvCG1YMaQ7KSqwlWhU8NrFM-omVGGj6StO0Mqs_WzXZtP846Q3sspmCvTAFdewANbquUEI7UeCZ0FRBgHIuuz5HjOhj0VrJrooC8MHBSGo_QpIdj7ijlYPuCavT0-CMWREGHg15MVI4A12lUQuOwiW6WEqQLdYwiw8_i3oZYbnuFrtdv_eQdNgcTEQJLLOvkLYV6fkByarFTgs5VMQUNdOeHNBN1YaEqgmmPvbmSLJ4z-tkU-xnvLvz3ezcsP3BZDQMh8_j1wt2YBSlADJesnq6yuCKnI1UX-c69gPbM9X8
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2015+11th+IEEE+International+Conference+and+Workshops+on+Automatic+Face+and+Gesture+Recognition+%28FG%29&rft.atitle=Cross-cultural+detection+of+depression+from+nonverbal+behaviour&rft.au=Alghowinem%2C+Sharifa&rft.au=Goecke%2C+Roland&rft.au=Cohn%2C+Jeffrey+F.&rft.au=Wagner%2C+Michael&rft.date=2015-05-01&rft.pub=IEEE&rft.volume=1&rft.spage=1&rft.epage=8&rft_id=info:doi/10.1109%2FFG.2015.7163113&rft.externalDocID=7163113
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2326-5396&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2326-5396&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2326-5396&client=summon