Multimodal analysis of personality traits on videos of self-presentation and induced behavior
Personality analysis is an important area of research in several fields, including psychology, psychiatry, and neuroscience. With the recent dramatic improvements in machine learning, it has also become a popular research area in computer science. While the current computational methods are able to...
Saved in:
| Published in | Journal on multimodal user interfaces Vol. 15; no. 4; pp. 337 - 358 |
|---|---|
| Main Authors | , , , , , , , , , |
| Format | Journal Article |
| Language | English |
| Published |
Cham
Springer International Publishing
01.12.2021
Springer Nature B.V |
| Subjects | |
| Online Access | Get full text |
Cover
Loading…
| Abstract | Personality analysis is an important area of research in several fields, including psychology, psychiatry, and neuroscience. With the recent dramatic improvements in machine learning, it has also become a popular research area in computer science. While the current computational methods are able to interpret behavioral cues (e.g., facial expressions, gesture, and voice) to estimate the level of (apparent) personality traits, accessible assessment tools are still substandard for practical use, not to mention the need for fast and accurate methods for such analyses. In this study, we present multimodal deep architectures to estimate the Big Five personality traits from (temporal) audio-visual cues and transcribed speech. Furthermore, for a detailed analysis of personality traits, we have collected a new audio-visual dataset, namely: Self-presentation and Induced Behavior Archive for Personality Analysis (SIAP). In contrast to the available datasets, SIAP introduces recordings of induced behavior in addition to self-presentation (speech) videos. With thorough experiments on SIAP and ChaLearn LAP First Impressions datasets, we systematically assess the reliability of different behavioral modalities and their combined use. Furthermore, we investigate the characteristics and discriminative power of induced behavior for personality analysis, showing that the induced behavior indeed includes signs of personality traits. |
|---|---|
| AbstractList | Personality analysis is an important area of research in several fields, including psychology, psychiatry, and neuroscience. With the recent dramatic improvements in machine learning, it has also become a popular research area in computer science. While the current computational methods are able to interpret behavioral cues (e.g., facial expressions, gesture, and voice) to estimate the level of (apparent) personality traits, accessible assessment tools are still substandard for practical use, not to mention the need for fast and accurate methods for such analyses. In this study, we present multimodal deep architectures to estimate the Big Five personality traits from (temporal) audio-visual cues and transcribed speech. Furthermore, for a detailed analysis of personality traits, we have collected a new audio-visual dataset, namely: Self-presentation and Induced Behavior Archive for Personality Analysis (SIAP). In contrast to the available datasets, SIAP introduces recordings of induced behavior in addition to self-presentation (speech) videos. With thorough experiments on SIAP and ChaLearn LAP First Impressions datasets, we systematically assess the reliability of different behavioral modalities and their combined use. Furthermore, we investigate the characteristics and discriminative power of induced behavior for personality analysis, showing that the induced behavior indeed includes signs of personality traits. |
| Author | Mandira, Burak Akgür, Berhan Faruk Kınıklıoğlu, Merve Giritlioğlu, Dersu Ertenli, Can Ufuk Dibeklioğlu, Hamdi Mutlu, Emre Kurt, Aslı Gül Gürel, Şeref Can Yilmaz, Selim Firat |
| Author_xml | – sequence: 1 givenname: Dersu orcidid: 0000-0003-1503-0213 surname: Giritlioğlu fullname: Giritlioğlu, Dersu email: dersu@bilkent.edu.tr organization: Department of Computer Engineering, Bilkent University – sequence: 2 givenname: Burak orcidid: 0000-0001-9605-8642 surname: Mandira fullname: Mandira, Burak organization: Department of Computer Engineering, Bilkent University – sequence: 3 givenname: Selim Firat orcidid: 0000-0002-0486-7731 surname: Yilmaz fullname: Yilmaz, Selim Firat organization: Department of Electrical and Electronics Engineering, Bilkent University – sequence: 4 givenname: Can Ufuk orcidid: 0000-0001-7795-3617 surname: Ertenli fullname: Ertenli, Can Ufuk organization: Department of Computer Engineering, Middle East Technical University – sequence: 5 givenname: Berhan Faruk surname: Akgür fullname: Akgür, Berhan Faruk organization: Department of Neuroscience, Bilkent University – sequence: 6 givenname: Merve surname: Kınıklıoğlu fullname: Kınıklıoğlu, Merve organization: Department of Neuroscience, Bilkent University – sequence: 7 givenname: Aslı Gül orcidid: 0000-0001-5222-8291 surname: Kurt fullname: Kurt, Aslı Gül organization: Department of Neuroscience, Bilkent University – sequence: 8 givenname: Emre orcidid: 0000-0001-6604-2105 surname: Mutlu fullname: Mutlu, Emre organization: Psychiatry Clinic, Etimesgut Şehit Sait Ertürk State Hospital – sequence: 9 givenname: Şeref Can orcidid: 0000-0003-3261-6611 surname: Gürel fullname: Gürel, Şeref Can organization: Department of Psychiatry, Hacettepe University, Department of Cognitive Neuroscience, Maastricht University – sequence: 10 givenname: Hamdi orcidid: 0000-0003-0851-7808 surname: Dibeklioğlu fullname: Dibeklioğlu, Hamdi organization: Department of Computer Engineering, Bilkent University |
| BookMark | eNp9UMtOwzAQtFCRKKU_wCkS54CfsX1EFS-piAsckeUkDrhK7WA7lfr3uE0lbuxlXzOj3bkEM-edAeAawVsEIb-LCCNJSohhCSGhvORnYI64IKXgRMxONa84vwDLGDcwB8F5Rufg83Xsk936VveFdrrfRxsL3xWDCdHn3qZ9kYK2KU9dsbOt8cd9NH1XDsFE45JONu-0awvr2rExbVGbb72zPlyB80730SxPeQE-Hh_eV8_l-u3pZXW_LhtSkVR2jFHCmUaVEUzAWjCJayy1EJK0rKK6gbVkhArcIcoQarmEUnKa_0KawIoswM2kOwT_M5qY1MaPIZ8fFWYCUwKR5BmFJ1QTfIzBdGoIdqvDXiGoDk6qyUmVnVRHJ9WBRCZSzGD3ZcKf9D-sX5PDdvc |
| CitedBy_id | crossref_primary_10_1007_s11760_023_02898_0 crossref_primary_10_1145_3674971 crossref_primary_10_3390_app121910066 crossref_primary_10_1109_ACCESS_2023_3243854 crossref_primary_10_1016_j_eswa_2023_122441 crossref_primary_10_1016_j_patrec_2024_07_004 |
| Cites_doi | 10.1037/11491-005 10.21437/Interspeech.2012-125 10.21037/mhealth.2018.03.02 10.4274/npa.y6128 10.1007/978-3-319-49409-8_28 10.1037/0022-3514.93.5.751 10.1590/1516-4446-2019-0645 10.1371/journal.pone.0144610 10.1016/j.schres.2008.01.024 10.1016/j.jad.2018.11.002 10.1109/ICIP.2014.7025852 10.1109/TAFFC.2019.2930058 10.1109/TAFFC.2017.2762299 10.1007/978-3-030-11024-6_44 10.1007/978-3-319-49409-8_27 10.1097/PRA.0000000000000392 10.1027/1614-0001/a000270 10.1176/appi.ajp.159.3.359 10.1038/s41598-017-02346-3 10.1016/j.jad.2007.10.022 10.1109/CVPR.2018.00685 10.1109/ACII.2013.65 10.1023/A:1022117500440 10.1109/CVPR.2016.251 10.1016/j.cviu.2016.10.013 10.1109/FG.2015.7163100 10.1109/TAFFC.2015.2513401 10.1037/a0020327 10.1016/S0092-6566(03)00046-1 10.1097/NMD.0000000000000071 10.1109/CVPR.2017.143 10.1017/CBO9780511596544 10.1109/CVPR.2017.634 10.1109/CVPRW.2017.210 10.1007/978-3-319-49409-8_30 10.1109/CVPRW.2017.212 10.1016/B978-012134645-4/50031-7 10.1037/0022-3514.81.2.322 10.5244/C.29.41 10.1007/978-3-319-27671-7_45 10.1145/2813524.2813528 10.1186/1477-7525-2-15 10.1007/978-3-319-49409-8_32 10.2466/pr0.1966.19.1.3 10.1145/2659522.2659526 10.4306/pi.2012.9.4.347 10.3389/fpsyg.2011.00178 10.1109/ICPR.2016.7899605 10.1109/CVPRW.2017.217 10.1109/TMM.2012.2225032 10.1016/j.schres.2015.06.028 10.1177/0146167202289013 10.1016/j.psychres.2013.06.040 10.1016/j.psychres.2010.05.020 10.1109/FG.2018.00019 10.1109/CVPRW.2017.211 10.1037/0033-2909.116.3.429 10.1109/TAFFC.2017.2751469 10.1177/1088868306294907 10.1192/bjp.186.3.190 10.1109/CVPR.2016.90 10.1016/j.psychres.2016.04.004 10.1016/j.chb.2015.06.032 10.1145/3209978.3210006 10.1145/2993148.2997632 10.1111/j.1467-6494.1992.tb00970.x 10.1037/0022-3514.59.6.1216 10.1109/TAFFC.2014.2330816 10.3389/fpsyg.2019.01185 10.1006/jrpe.2001.2322 10.1145/2522848.2522858 10.1109/TAFFC.2020.2973984 10.1111/j.1467-9280.2006.01750.x 10.1145/2659522.2659531 10.1016/j.paid.2011.10.022 10.1609/aaai.v29i1.9513 10.1186/1741-7015-9-90 |
| ContentType | Journal Article |
| Copyright | Springer Nature Switzerland AG 2020 Springer Nature Switzerland AG 2020. |
| Copyright_xml | – notice: Springer Nature Switzerland AG 2020 – notice: Springer Nature Switzerland AG 2020. |
| DBID | AAYXX CITATION |
| DOI | 10.1007/s12193-020-00347-7 |
| DatabaseName | CrossRef |
| DatabaseTitle | CrossRef |
| DatabaseTitleList | |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Computer Science Psychology |
| EISSN | 1783-8738 |
| EndPage | 358 |
| ExternalDocumentID | 10_1007_s12193_020_00347_7 |
| GroupedDBID | -59 -5G -BR -EM -Y2 -~C .VR 06D 0R~ 0VY 1N0 203 29L 2J2 2JN 2JY 2KG 2KM 2LR 2VQ 2~H 30V 4.4 406 408 40D 40E 5GY 5VS 6NX 95- 95. 95~ 96X AAAVM AABHQ AAFGU AAHNG AAIAL AAJKR AANZL AARHV AARTL AATNV AATVU AAUYE AAWCG AAYFA AAYIU AAYQN AAYTO ABDZT ABECU ABFGW ABFTD ABFTV ABHLI ABHQN ABJNI ABJOX ABKAS ABKCH ABMNI ABMQK ABNWP ABQBU ABSXP ABTEG ABTHY ABTKH ABTMW ABULA ABWNU ABXPI ACBMV ACBRV ACBYP ACGFS ACHSB ACHXU ACIGE ACIPQ ACKNC ACMDZ ACMLO ACOKC ACOMO ACSNA ACTTH ACVWB ACWMK ADHHG ADHIR ADINQ ADKNI ADKPE ADMDM ADOXG ADRFC ADTPH ADURQ ADYFF ADZKW AEBTG AEFTE AEGAL AEGNC AEJHL AEJRE AEKMD AENEX AEOHA AEPYU AESKC AESTI AETLH AEVLU AEVTX AEXYK AFGCZ AFLOW AFNRJ AFQWF AFWTZ AFZKB AGAYW AGDGC AGGBP AGJBK AGMZJ AGQMX AGWIL AGWZB AGYKE AHAVH AHBYD AHKAY AHSBF AHYZX AIAKS AIIXL AILAN AIMYW AITGF AJBLW AJDOV AJRNO AJZVZ AKQUC ALMA_UNASSIGNED_HOLDINGS ALWAN AMKLP AMXSW AMYLF AMYQR AOCGG ARMRJ AXYYD AYJHY B-. BA0 BDATZ BGNMA CAG COF CS3 CSCUP DDRTE DNIVK DPUIP EBLON EBS EIOEI EJD ESBYG FERAY FFXSO FIGPU FINBP FNLPD FRRFC FSGXE FWDCC GGCAI GGRSB GJIRD GNWQR GQ6 GQ7 HF~ HG6 HLICF HMJXF HRMNR HZ~ IJ- IKXTQ IWAJR IXC IXD I~X I~Z J-C J0Z JBSCW JZLTJ KOV LLZTM M4Y MA- N9A NPVJJ NQJWS NU0 O9- O93 O9J P9O PF0 PT4 QOS R89 R9I ROL RPX RSV S16 S1Z S27 S3B SAP SCO SDH SHX SISQX SNE SNPRN SNX SOHCF SOJ SPISZ SRMVM SSLCW STPWE SZN T13 TSG TSV TUC U2A UG4 UNUBA UOJIU UTJUX UZXMN VC2 VFIZW W48 WK8 YLTOR Z45 Z7X Z83 Z88 ZMTXR ~A9 AACDK AAJBT AASML AAYXX ABAKF ACAOD ACDTI ACZOJ AEFQL AEMSY AFBBN AGQEE AGRTI AIGIU CITATION H13 SJYHP |
| ID | FETCH-LOGICAL-c363t-f554375a16e8580b8592b29a8893d564ac0b953482f14511d79099741781a3063 |
| IEDL.DBID | AGYKE |
| ISSN | 1783-7677 |
| IngestDate | Fri Sep 13 00:24:04 EDT 2024 Thu Sep 12 18:09:29 EDT 2024 Sat Dec 16 12:09:09 EST 2023 |
| IsDoiOpenAccess | false |
| IsOpenAccess | true |
| IsPeerReviewed | false |
| IsScholarly | true |
| Issue | 4 |
| Keywords | Deep learning Induced behavior Estimation of personality traits Self-presentation Big five Multimodal fusion |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c363t-f554375a16e8580b8592b29a8893d564ac0b953482f14511d79099741781a3063 |
| ORCID | 0000-0001-9605-8642 0000-0001-7795-3617 0000-0001-5222-8291 0000-0001-6604-2105 0000-0003-1503-0213 0000-0003-0851-7808 0000-0002-0486-7731 0000-0003-3261-6611 |
| OpenAccessLink | http://repository.bilkent.edu.tr/bitstream/11693/75892/1/Multimodal_analysis_of_personality_traits_on_videos_of_self-presentation_and_induced_behavior.pdf |
| PQID | 2582430197 |
| PQPubID | 2044316 |
| PageCount | 22 |
| ParticipantIDs | proquest_journals_2582430197 crossref_primary_10_1007_s12193_020_00347_7 springer_journals_10_1007_s12193_020_00347_7 |
| PublicationCentury | 2000 |
| PublicationDate | 2021-12-01 |
| PublicationDateYYYYMMDD | 2021-12-01 |
| PublicationDate_xml | – month: 12 year: 2021 text: 2021-12-01 day: 01 |
| PublicationDecade | 2020 |
| PublicationPlace | Cham |
| PublicationPlace_xml | – name: Cham – name: Heidelberg |
| PublicationTitle | Journal on multimodal user interfaces |
| PublicationTitleAbbrev | J Multimodal User Interfaces |
| PublicationYear | 2021 |
| Publisher | Springer International Publishing Springer Nature B.V |
| Publisher_xml | – name: Springer International Publishing – name: Springer Nature B.V |
| References | Devlin J, Chang MW, Lee K, Toutanova K (2018) Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 EscalanteHJKayaHSalahAAEscaleraSGüçYGüçlüUBaróXGuyonIJacquesJCSMadadiMAyacheSViegasEGurpinarFWicaksanaASLiemCVan GervenMAVan LierRModeling, recognizing, and explaining apparent personality from videosIEEE Trans Affect Comput202010.1109/TAFFC.2020.2973984 BrometEAndradeLHHwangISampsonNAAlonsoJDe GirolamoGDe GraafRDemyttenaereKHuCIwataNKaramAKaurJKostyuchenkoSLépineJPLevinsonDMatschingerHMoraMBrowneMPosada-VillaJVianaMWilliamsDKesslerRCross-national epidemiology of DSM-IV major depressive episodeBMC Med2011919010.1186/1741-7015-9-90 WeisbergYJDeYoungCGHirshJBGender differences in personality across the ten aspects of the big fiveFront Psychol20112178 10.3389/fpsyg.2011.00178 Guntuku SC, Qiu L, Roy S, Lin W, Jakhetiya V (2015) Do others perceive you as you want them to? modeling personality based on selfies. In: Proceedings of the 1st international workshop on affect & sentiment in multimedia, pp 21–26 Gürpinar F, Kaya H, Salah AA (2016) Multimodal fusion of audio, scene, and face features for first impression estimation. In: Proceedings of the international conference on pattern recognition (ICPR), pp 43–48. IEEE Ventura C, Masip D, Lapedriza A (2017) Interpreting CNN models for apparent personality trait regression. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 55–63 Hara K, Kataoka H, Satoh Y (2018) Can spatiotemporal 3D CNNS retrace the history of 2D CNNS and imagenet? In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 6546–6555 PedregonCAFarleyRLDavisAWoodJMClarkRDSocial desirability, personality questionnaires, and the “better than average” effectPersonality Individ Differ201252221321710.1016/j.paid.2011.10.022 QiuLLuJYangSQuWZhuTWhat does your selfie say about you?Comput Hum Behav20155244344910.1016/j.chb.2015.06.032 Baltrusaitis T, Zadeh A, Lim YC, Morency LP (2018) Openface 2.0: facial behavior analysis toolkit. In: Proceedings of the 13th IEEE international conference on automatic face & gesture recognition (FG 2018), pp 59–66. IEEE ZilligLMPHemenoverSHDienstbierRAWhat do we assess when we assess a big 5 trait? a content analysis of the affective, behavioral, and cognitive processes represented in big 5 personality inventoriesPers Soc Psychol Bull200228684785810.1177/0146167202289013 Almaev TR, Valstar MF (2013) Local Gabor binary patterns from three orthogonal planes for automatic facial expression recognition. In: Humaine association conference on affective computing and intelligent interaction, pp 356–361. IEEE HassanSAkhtarNYılmazAKImpact of the conscientiousness as personality trait on both job and organizational performanceJ Manag Sci2016101114 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 770–778. Retrieved from https://repository.upenn.edu/asc_papers/43. Accessed 6 Oct 2020 KeltnerDEkmanPGonzagaGCBeerJDavidsonRJSchererKRGoldsmithHHFacial expressions of emotionHandbook of affective sciences2003New YorkOxford University Press415432 RiggioHRRiggioREEmotional expressiveness, extraversion, and neuroticism: a meta-analysisJ Nonverbal Behav200226419521810.1023/A:1022117500440 BoyetteLLKorver-NiebergNMeijerCde HaanLGenetic risk and outcome of psychosis investigators: quality of life in patients with psychotic disorders: impact of symptoms, personality, and attachmentJ Nerv Ment Dis20142021646910.1097/NMD.0000000000000071 KotovRGamezWSchmidtFWatsonDLinking “big” personality traits to anxiety, depressive, and substance use disorders: a meta-analysisPsychol Bull2010136576810.1037/a0020327 GiannakopoulosTpyaudioanalysis: An open-source python library for audio signal analysisPloS ONE20151012e014461010.1371/journal.pone.0144610 SparkmanDJEidelmanSDuewekeARMarinMSDominguezBOpen to diversity: openness to experience predicts beliefs in multiculturalism and colorblindness through perspective takingJ Individ Diff201940111210.1027/1614-0001/a000270 Ponce-López V, Chen B, Oliu M, Corneanu C, Clapés A, Guyon I, Baró X, Escalante HJ, Escalera S (2016) Chalearn lap 2016: first round challenge on first impressions-dataset and results. In: Proceedings of the European conference on computer vision, pp 400–418. Springer AshtonMCLeeKEmpirical, theoretical, and practical advantages of the Hexaco model of personality structurePersonality Soc Psychol Rev200711215016610.1177/1088868306294907 Odić A, Tkalčič M, Tasič J, Košir A (2013) Personality and social context: impact on emotion induction from movies. In: Extended proceedings of the conference on user modeling, adaptation, and personalization Selçuk E, Günaydin G, Sümer N, Uysal A (2005) Yetişkin bağlanma boyutlan için yeni bir ölçüm: Yakın ilişkilerde yaşantılar envanteri-II’nin Türk örnekleminde psikometrik açıdan değerlendirilmesi. Türk Psikoloji Yazıları WillisJTodorovAFirst impressions: Making up your mind after a 100-ms exposure to a facePsychol Sci200617759259810.1111/j.1467-9280.2006.01750.x HusainMICarvalhoAFThe importance of assessing personality traits and disorders in clinical trials of major depressive disorderBraz J Psychiatry20204213410.1590/1516-4446-2019-0645 Huggingface: huggingface/pytorch-transformers (2019). https://github.com/huggingface/pytorch-transformers. Accessed 29 July 2019 SmelandOBWangYLoMTLiWFreiOWitoelarATesliMHindsDATungJYDjurovicSChenCHDaleAMAndreassenOAIdentification of genetic loci shared between schizophrenia and the big five personality traitsSci Rep2017711910.1038/s41598-017-02346-3 MulderRTPersonality pathology and treatment outcome in major depression: a reviewAm J Psychiatry2002159335937110.1176/appi.ajp.159.3.359 Valente F, Kim S, Motlicek P (2012) Annotation and recognition of personality traits in spoken conversations from the ami meetings corpus. In: Annual conference of the international speech communication association KimBJooYHKimSYLimJHKimEOPersonality traits and affective morbidity in patients with bipolar I disorder: the five-factor model perspectivePsychiatry Res20111851–213514010.1016/j.psychres.2010.05.020 Graziano WG, Eisenberg N (1997) Agreeableness: a dimension of personality. In: Handbook of personality psychology, pp 795–824. Elsevier SalemHRuizAHernandezSWahidKCaoFKarnesBBeasleySSanchesMAshtariEPigottTBorderline personality features in inpatients with bipolar disorder: impact on course and machine learning model use to predict rapid readmissionJ Psychiatr Pract201925427928910.1097/PRA.0000000000000392 WauthiaELefebvreLHuetKBlekicWEl BouraguiKRossignolMExamining the hierarchical influences of the big-five dimensions and anxiety sensitivity on anxiety symptoms in childrenFront Psychol201910118510.3389/fpsyg.2019.01185 Güçlütürk Y, Güçlü U, van Gerven MA, van Lier R (2016) Deep impression: audiovisual deep residual networks for multimodal apparent personality trait recognition. In: European conference on computer vision, pp 349–358. Springer van der MaatenLHintonGVisualizing data using t-SNEJ Mach Learn Res20089257926051225.68219 BoyetteLLKorver-NiebergNVerweijKMeijerCDingemansPCahnWde HaanLKahnRde HaanLvan OsJWiersmaDBruggemanRCahnWMeijerCMyin-GermeysIAssociations between the five-factor model personality traits and psychotic experiences in patients with psychotic disorders, their siblings and controlsPsychiatry Res2013210249149710.1016/j.psychres.2013.06.040 Silveira Jacques Junior JC, Güçlütürk Y, Pérez M, Güçlü U, Andujar C, Baró X, Escalante HJ, Guyon I, Van Gerven MA, Van Lier R, Escalera S (2019) First impressions: a survey on vision-based apparent personality trait analysis. IEEE Trans Affect Comput. https://doi.org/10.1109/TAFFC.2019.2930058 Fan Y, Lu X, Li D, Liu Y (2016) Video-based emotion recognition using CNN-RNN and C3D hybrid networks. In: Proceedings of the 18th ACM international conference on multimodal interaction, pp 445–450. ACM ChandrashekarPDo mental health mobile apps work: evidence and recommendations for designing high-efficacy mental health mobile appsMhealth20184610.21037/mhealth.2018.03.02 KhanAAJacobsonKCGardnerCOPrescottCAKendlerKSPersonality and comorbidity of common psychiatric disordersBr J Psychiatry2005186319019610.1192/bjp.186.3.190 Cao Z, Simon T, Wei SE, Sheikh Y (2017) Realtime multi-person 2D pose estimation using part affinity fields. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7291–7299 Parkhi OM, Vedaldi A, Zisserman A (2015) Deep face recognition. In: British machine vision conference. British Machine Vision Association WuXHeHShiLXiaYZuangKFengQZhangYRenZWeiDQiuJPersonality traits are related with dynamic functional connectivity in major depression disorder: a resting-state analysisJ Affect Disord20192451032104210.1016/j.jad.2018.11.002 LecomteTSpidelALeclercCMacEwanGWGreavesCBentallRPPredictors and profiles of treatment non-adherence and engagement in services problems in early psychosisSchizophr Res20081021–329530210.1016/j.schres.2008.01.024 Cucurull G, Rodríguez P, Yazici VO, Gonfaus JM, Roca FX, Gonzàlez J (2018) Deep inference of personality traits by integrating image and word use in social networks. arXiv preprint arXiv:1802.06757 BartkoJJThe intraclass correlation coefficient as a measure of reliabilityPsychol Rep196619131110.2466/pr0.1966.19.1.3 GüçlütürkYGüçlüUBaroXEscalanteHJGuyonIEscaleraSVan GervenMAVan LierRMultimodal first impression analysis with deep residual networksIEEE Trans Affect Comput20179331632910.1109/TAFFC.2017.2751469 FeingoldAGender differences in personality: a meta-analysisPsychol Bull1994116342910.1037/0033-2909.116.3.429 Subramaniam A, Patel V, Mishra A, Balasubramanian P, Mittal A (2016) Bi-modal first impressions recognition using temporally ordered deep audio and stochastic visual features. In: European conference on computer vision, pp 337–348. Springer Wicaksana AS, L 347_CR40 347_CR85 347_CR43 347_CR81 OB Smeland (347_CR73) 2017; 7 PT Costa Jr (347_CR22) 2001; 81 PH Lysaker (347_CR57) 2004; 2 J Willis (347_CR86) 2006; 17 347_CR44 347_CR88 347_CR89 347_CR46 347_CR47 347_CR5 Y Güçlütürk (347_CR35) 2017; 9 347_CR4 347_CR6 347_CR1 O Celiktutan (347_CR18) 2015; 8 347_CR3 L van der Maaten (347_CR58) 2008; 9 PJ Corr (347_CR21) 2009 A Hasan (347_CR41) 2013; 50 RT Mulder (347_CR60) 2002; 159 X Wu (347_CR87) 2019; 245 B Kim (347_CR50) 2011; 185 MC Ashton (347_CR7) 2007; 11 K Ohi (347_CR62) 2016; 240 C Segalin (347_CR70) 2017; 156 JJ Bartko (347_CR9) 1966; 19 E Wauthia (347_CR82) 2019; 10 347_CR53 347_CR10 347_CR54 MT Compton (347_CR20) 2015; 168 347_CR16 347_CR17 AA Khan (347_CR49) 2005; 186 347_CR55 347_CR8 P Chandrashekar (347_CR19) 2018; 4 JN Butcher (347_CR15) 1990 A Feingold (347_CR29) 1994; 116 MS Yik (347_CR90) 2001; 35 B Kim (347_CR51) 2012; 9 LL Boyette (347_CR12) 2014; 202 SD Gosling (347_CR33) 2003; 37 S Hassan (347_CR42) 2016; 10 347_CR63 347_CR65 D Keltner (347_CR48) 2003 H Salem (347_CR69) 2019; 25 347_CR61 T Lecomte (347_CR56) 2008; 102 HJ Escalante (347_CR26) 2020 347_CR27 347_CR28 RR McCrae (347_CR59) 1992; 60 JI Biel (347_CR11) 2012; 15 347_CR23 347_CR24 347_CR25 YJ Weisberg (347_CR84) 2011; 2 CA Pedregon (347_CR64) 2012; 52 LL Boyette (347_CR13) 2013; 210 R Kotov (347_CR52) 2010; 136 E Bromet (347_CR14) 2011; 9 LR Goldberg (347_CR32) 1990; 59 T Giannakopoulos (347_CR31) 2015; 10 L Qiu (347_CR66) 2015; 52 HR Riggio (347_CR68) 2002; 26 A Vinciarelli (347_CR80) 2014; 5 347_CR30 347_CR75 347_CR76 347_CR71 347_CR72 347_CR37 LMP Zillig (347_CR91) 2002; 28 347_CR38 MI Husain (347_CR45) 2020; 42 347_CR39 347_CR77 347_CR34 347_CR78 347_CR79 347_CR36 DJ Sparkman (347_CR74) 2019; 40 XS Wei (347_CR83) 2017; 9 LC Quilty (347_CR67) 2008; 108 AE Abele (347_CR2) 2007; 93 |
| References_xml | – ident: 347_CR75 doi: 10.1037/11491-005 – ident: 347_CR77 doi: 10.21437/Interspeech.2012-125 – volume: 4 start-page: 6 year: 2018 ident: 347_CR19 publication-title: Mhealth doi: 10.21037/mhealth.2018.03.02 contributor: fullname: P Chandrashekar – volume: 50 start-page: 312 issue: 4 year: 2013 ident: 347_CR41 publication-title: Nöro Psikiyatri Arşivi doi: 10.4274/npa.y6128 contributor: fullname: A Hasan – ident: 347_CR36 doi: 10.1007/978-3-319-49409-8_28 – volume: 93 start-page: 751 issue: 5 year: 2007 ident: 347_CR2 publication-title: J Pers Soc Psychol doi: 10.1037/0022-3514.93.5.751 contributor: fullname: AE Abele – volume: 42 start-page: 3 issue: 1 year: 2020 ident: 347_CR45 publication-title: Braz J Psychiatry doi: 10.1590/1516-4446-2019-0645 contributor: fullname: MI Husain – volume: 10 start-page: e0144610 issue: 12 year: 2015 ident: 347_CR31 publication-title: PloS ONE doi: 10.1371/journal.pone.0144610 contributor: fullname: T Giannakopoulos – volume: 102 start-page: 295 issue: 1–3 year: 2008 ident: 347_CR56 publication-title: Schizophr Res doi: 10.1016/j.schres.2008.01.024 contributor: fullname: T Lecomte – volume: 245 start-page: 1032 year: 2019 ident: 347_CR87 publication-title: J Affect Disord doi: 10.1016/j.jad.2018.11.002 contributor: fullname: X Wu – ident: 347_CR17 doi: 10.1109/ICIP.2014.7025852 – ident: 347_CR72 doi: 10.1109/TAFFC.2019.2930058 – volume: 9 start-page: 303 issue: 3 year: 2017 ident: 347_CR83 publication-title: IEEE Trans Affect Comput doi: 10.1109/TAFFC.2017.2762299 contributor: fullname: XS Wei – volume: 10 start-page: 1 issue: 1 year: 2016 ident: 347_CR42 publication-title: J Manag Sci contributor: fullname: S Hassan – volume: 9 start-page: 2579 year: 2008 ident: 347_CR58 publication-title: J Mach Learn Res contributor: fullname: L van der Maaten – ident: 347_CR79 doi: 10.1007/978-3-030-11024-6_44 – ident: 347_CR76 doi: 10.1007/978-3-319-49409-8_27 – volume: 25 start-page: 279 issue: 4 year: 2019 ident: 347_CR69 publication-title: J Psychiatr Pract doi: 10.1097/PRA.0000000000000392 contributor: fullname: H Salem – volume: 40 start-page: 1 issue: 1 year: 2019 ident: 347_CR74 publication-title: J Individ Diff doi: 10.1027/1614-0001/a000270 contributor: fullname: DJ Sparkman – volume: 159 start-page: 359 issue: 3 year: 2002 ident: 347_CR60 publication-title: Am J Psychiatry doi: 10.1176/appi.ajp.159.3.359 contributor: fullname: RT Mulder – volume: 7 start-page: 1 issue: 1 year: 2017 ident: 347_CR73 publication-title: Sci Rep doi: 10.1038/s41598-017-02346-3 contributor: fullname: OB Smeland – volume: 108 start-page: 241 issue: 3 year: 2008 ident: 347_CR67 publication-title: J Affect Disord doi: 10.1016/j.jad.2007.10.022 contributor: fullname: LC Quilty – ident: 347_CR40 doi: 10.1109/CVPR.2018.00685 – ident: 347_CR5 doi: 10.1109/ACII.2013.65 – volume: 26 start-page: 195 issue: 4 year: 2002 ident: 347_CR68 publication-title: J Nonverbal Behav doi: 10.1023/A:1022117500440 contributor: fullname: HR Riggio – ident: 347_CR81 doi: 10.1109/CVPR.2016.251 – volume: 156 start-page: 34 year: 2017 ident: 347_CR70 publication-title: Comput Vis Image Underst doi: 10.1016/j.cviu.2016.10.013 contributor: fullname: C Segalin – ident: 347_CR1 doi: 10.1109/FG.2015.7163100 – volume: 8 start-page: 29 issue: 1 year: 2015 ident: 347_CR18 publication-title: IEEE Trans Affect Comput doi: 10.1109/TAFFC.2015.2513401 contributor: fullname: O Celiktutan – volume: 136 start-page: 768 issue: 5 year: 2010 ident: 347_CR52 publication-title: Psychol Bull doi: 10.1037/a0020327 contributor: fullname: R Kotov – volume: 37 start-page: 504 issue: 6 year: 2003 ident: 347_CR33 publication-title: J Res Pers doi: 10.1016/S0092-6566(03)00046-1 contributor: fullname: SD Gosling – volume: 202 start-page: 64 issue: 1 year: 2014 ident: 347_CR12 publication-title: J Nerv Ment Dis doi: 10.1097/NMD.0000000000000071 contributor: fullname: LL Boyette – ident: 347_CR16 doi: 10.1109/CVPR.2017.143 – volume-title: The Cambridge handbook of personality psychology year: 2009 ident: 347_CR21 doi: 10.1017/CBO9780511596544 contributor: fullname: PJ Corr – ident: 347_CR88 doi: 10.1109/CVPR.2017.634 – ident: 347_CR47 doi: 10.1109/CVPRW.2017.210 – ident: 347_CR4 – ident: 347_CR38 doi: 10.1007/978-3-319-49409-8_30 – ident: 347_CR85 doi: 10.1109/CVPRW.2017.212 – ident: 347_CR34 doi: 10.1016/B978-012134645-4/50031-7 – ident: 347_CR46 – volume: 81 start-page: 322 issue: 2 year: 2001 ident: 347_CR22 publication-title: J Pers Soc Psychol doi: 10.1037/0022-3514.81.2.322 contributor: fullname: PT Costa Jr – ident: 347_CR24 – ident: 347_CR30 – ident: 347_CR63 doi: 10.5244/C.29.41 – ident: 347_CR89 doi: 10.1007/978-3-319-27671-7_45 – start-page: 415 volume-title: Handbook of affective sciences year: 2003 ident: 347_CR48 contributor: fullname: D Keltner – ident: 347_CR37 doi: 10.1145/2813524.2813528 – volume: 2 start-page: 15 issue: 1 year: 2004 ident: 347_CR57 publication-title: Health Qual Life Outcomes doi: 10.1186/1477-7525-2-15 contributor: fullname: PH Lysaker – ident: 347_CR65 doi: 10.1007/978-3-319-49409-8_32 – volume: 19 start-page: 3 issue: 1 year: 1966 ident: 347_CR9 publication-title: Psychol Rep doi: 10.2466/pr0.1966.19.1.3 contributor: fullname: JJ Bartko – ident: 347_CR28 doi: 10.1145/2659522.2659526 – volume: 9 start-page: 347 issue: 4 year: 2012 ident: 347_CR51 publication-title: Psychiatry Investig doi: 10.4306/pi.2012.9.4.347 contributor: fullname: B Kim – ident: 347_CR53 – volume: 2 start-page: 178 year: 2011 ident: 347_CR84 publication-title: Front Psychol doi: 10.3389/fpsyg.2011.00178 contributor: fullname: YJ Weisberg – ident: 347_CR39 doi: 10.1109/ICPR.2016.7899605 – ident: 347_CR10 – ident: 347_CR78 doi: 10.1109/CVPRW.2017.217 – volume: 15 start-page: 41 issue: 1 year: 2012 ident: 347_CR11 publication-title: IEEE Trans Multimedia doi: 10.1109/TMM.2012.2225032 contributor: fullname: JI Biel – volume: 168 start-page: 113 issue: 1–2 year: 2015 ident: 347_CR20 publication-title: Schizophr Res doi: 10.1016/j.schres.2015.06.028 contributor: fullname: MT Compton – volume: 28 start-page: 847 issue: 6 year: 2002 ident: 347_CR91 publication-title: Pers Soc Psychol Bull doi: 10.1177/0146167202289013 contributor: fullname: LMP Zillig – volume: 210 start-page: 491 issue: 2 year: 2013 ident: 347_CR13 publication-title: Psychiatry Res doi: 10.1016/j.psychres.2013.06.040 contributor: fullname: LL Boyette – volume: 185 start-page: 135 issue: 1–2 year: 2011 ident: 347_CR50 publication-title: Psychiatry Res doi: 10.1016/j.psychres.2010.05.020 contributor: fullname: B Kim – ident: 347_CR8 doi: 10.1109/FG.2018.00019 – ident: 347_CR25 doi: 10.1109/CVPRW.2017.211 – volume: 116 start-page: 429 issue: 3 year: 1994 ident: 347_CR29 publication-title: Psychol Bull doi: 10.1037/0033-2909.116.3.429 contributor: fullname: A Feingold – volume-title: Development and use of the MMPI-2 content scales year: 1990 ident: 347_CR15 contributor: fullname: JN Butcher – volume: 9 start-page: 316 issue: 3 year: 2017 ident: 347_CR35 publication-title: IEEE Trans Affect Comput doi: 10.1109/TAFFC.2017.2751469 contributor: fullname: Y Güçlütürk – volume: 11 start-page: 150 issue: 2 year: 2007 ident: 347_CR7 publication-title: Personality Soc Psychol Rev doi: 10.1177/1088868306294907 contributor: fullname: MC Ashton – volume: 186 start-page: 190 issue: 3 year: 2005 ident: 347_CR49 publication-title: Br J Psychiatry doi: 10.1192/bjp.186.3.190 contributor: fullname: AA Khan – ident: 347_CR43 doi: 10.1109/CVPR.2016.90 – volume: 240 start-page: 34 year: 2016 ident: 347_CR62 publication-title: Psychiatry Res doi: 10.1016/j.psychres.2016.04.004 contributor: fullname: K Ohi – ident: 347_CR71 – volume: 52 start-page: 443 year: 2015 ident: 347_CR66 publication-title: Comput Hum Behav doi: 10.1016/j.chb.2015.06.032 contributor: fullname: L Qiu – ident: 347_CR54 doi: 10.1145/3209978.3210006 – ident: 347_CR27 doi: 10.1145/2993148.2997632 – volume: 60 start-page: 175 issue: 2 year: 1992 ident: 347_CR59 publication-title: J Pers doi: 10.1111/j.1467-6494.1992.tb00970.x contributor: fullname: RR McCrae – volume: 59 start-page: 1216 issue: 6 year: 1990 ident: 347_CR32 publication-title: J Pers Soc Psychol doi: 10.1037/0022-3514.59.6.1216 contributor: fullname: LR Goldberg – volume: 5 start-page: 273 issue: 3 year: 2014 ident: 347_CR80 publication-title: IEEE Trans Affect Comput doi: 10.1109/TAFFC.2014.2330816 contributor: fullname: A Vinciarelli – volume: 10 start-page: 1185 year: 2019 ident: 347_CR82 publication-title: Front Psychol doi: 10.3389/fpsyg.2019.01185 contributor: fullname: E Wauthia – volume: 35 start-page: 247 issue: 3 year: 2001 ident: 347_CR90 publication-title: J Res Pers doi: 10.1006/jrpe.2001.2322 contributor: fullname: MS Yik – ident: 347_CR6 doi: 10.1145/2522848.2522858 – year: 2020 ident: 347_CR26 publication-title: IEEE Trans Affect Comput doi: 10.1109/TAFFC.2020.2973984 contributor: fullname: HJ Escalante – ident: 347_CR44 – volume: 17 start-page: 592 issue: 7 year: 2006 ident: 347_CR86 publication-title: Psychol Sci doi: 10.1111/j.1467-9280.2006.01750.x contributor: fullname: J Willis – ident: 347_CR3 doi: 10.1145/2659522.2659531 – volume: 52 start-page: 213 issue: 2 year: 2012 ident: 347_CR64 publication-title: Personality Individ Differ doi: 10.1016/j.paid.2011.10.022 contributor: fullname: CA Pedregon – ident: 347_CR23 – ident: 347_CR55 doi: 10.1609/aaai.v29i1.9513 – ident: 347_CR61 – volume: 9 start-page: 90 issue: 1 year: 2011 ident: 347_CR14 publication-title: BMC Med doi: 10.1186/1741-7015-9-90 contributor: fullname: E Bromet |
| SSID | ssj0000327834 |
| Score | 2.3151464 |
| Snippet | Personality analysis is an important area of research in several fields, including psychology, psychiatry, and neuroscience. With the recent dramatic... |
| SourceID | proquest crossref springer |
| SourceType | Aggregation Database Publisher |
| StartPage | 337 |
| SubjectTerms | Behavior Computer Science Cues Datasets Image Processing and Computer Vision Machine learning Original Paper Personality Personality traits Psychiatry Psychology Reliability analysis Signal,Image and Speech Processing Speech User Interfaces and Human Computer Interaction Video |
| Title | Multimodal analysis of personality traits on videos of self-presentation and induced behavior |
| URI | https://link.springer.com/article/10.1007/s12193-020-00347-7 https://www.proquest.com/docview/2582430197/abstract/ |
| Volume | 15 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV07T8MwED5BWVgoT1EelQc2cJXGcWyPFaIgEExUggFFdhwvQFLRsPDrObuJIl4Da86xFJ_P_hzf9x3ASeTyQmmdUiOcoIlTjBqLDjFOIbotrFZBdvH2Lr2aJdcP_KHjcYdk9_ZGMizUHdcNY8tfOXoiNEsEFauwxn1Z6h6sTS4fb7pfKxEL5SMCFVIyKlIhGrrM7x193ZI6nPntajTsONM-3Le8nWWiyfPovTaj_OOnjON_PmYTNhoESibLKbMFK0W5Df22ugNpgn0HngI397Wy2Fg30iWkcmTewXfiC0zU-LQkns5XBfuieHF03rGaSnzbEjz64ySypJUF2IXZ9OL-_Io2xRhozlJWU4e4gwmux2khuYyM5Co2sdISAY_laaLzyCjupXKcL_47tkJ5Um6CLhhrPJewPeiVVVnsA8mZRhjpuHXKJMI4iYcoy421TEmey3wAp60_svlScyPr1JX9yGU4clkYuUwM4Kh1WdbE3yKLuYwTXLsUms9aF3Tmv3s7-F_zQ1iPfZJLyG85gl799l4cI0qpzbCZlUNYncWTT5pL3Qk |
| link.rule.ids | 315,786,790,27957,27958,41116,41558,42185,42627,52146,52269 |
| linkProvider | Springer Nature |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV07T8MwED5BO8BCeYo3HtjAqI3j2B4rBBQKTK0EA4rsOF6AtKJh4ddzdhNFVDCwxo6V-Pz47LvvO4DTrstypXVCjXCCxk4xaiwaxDiF6Da3WgXZxYfHZDCO7574U0UKm9XR7rVLMqzUDdkNJ5f3OXomNIsFFcvQjnGH4i1o92-eh83dSpeF_BGBCykZFYkQFV_m94Z-7kkN0FzwjYYt57oD4_pj55EmrxefpbnIvhZ0HP_7N-uwVmFQ0p8Pmg1YyotN6NT5HUg13bfgJbBz3ycWK-tKvIRMHJk2AJ74FBMlPi2IJ_RNQvksf3N02vCaCnzbEjz84zCypBYG2Ibx9dXockCrdAw0YwkrqUPkwQTXvSSXXHaN5CoykdISIY_lSayzrlHci-U4n_63Z4XytNwYbdDTeDJhO9AqJkW-CyRjGoGk49YpEwvjJB6jLDfWMiV5JrM9OKsNkk7nqhtpo6_sey7FnktDz6ViDw5rm6XVDJylEZdRjKuXwuLz2gRN8d-t7f-v-gmsDEYP9-n97ePwAFYjH_ISol0OoVV-fOZHiFlKc1wN0W942N_0 |
| linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV1LT8QgECa6mxgvvo3rk4M3Ze2WUuC4Udf3xoMmejANlJIYtbvRevHXO9A21Y0ejNdCScsM8AHzfYPQbmDTTCoVE80tJ5GVlGgDBtFWArrNjJJedvFqGJ_eRud37O4Li99Hu9dXkiWnwak05cXB2NiDhvgGA83dPzpWNI044dOoHcGwBR9v90_uL5pzloD6XBKeFyko4THnFXfm54a-r08N6Jy4J_XLz2AeqfrDy6iTp-57obvpx4Sm43_-bAHNVdgU90tnWkRTWb6E5uu8D7iaBpbRg2ftvowMVFaVqAkeWTxugD12qScKeJpjR_Qb-fK37NmSccN3yuFtgx9zA-5lcC0YsIJuB8c3h6ekStNAUhrTglhAJJQz1YszwUSgBZOhDqUSAIUMiyOVBloyJ6JjXVrgnuHS0XUjsEdPwY6FrqJWPsqzNYRTqgBgWmas1BHXVsD2yjBtDJWCpSLtoL3aOMm4VONIGt1l13MJ9Fziey7hHbRZ2y-pRuZbEjIRRjCrSSjer83RFP_e2vrfqu-gmeujQXJ5NrzYQLOhi4TxQTCbqFW8vmdbAGUKvV156ye57OjP |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Multimodal+analysis+of+personality+traits+on+videos+of+self-presentation+and+induced+behavior&rft.jtitle=Journal+on+multimodal+user+interfaces&rft.au=Giritlio%C4%9Flu%2C+Dersu&rft.au=Mandira%2C+Burak&rft.au=Yilmaz%2C+Selim+Firat&rft.au=Ertenli%2C+Can+Ufuk&rft.date=2021-12-01&rft.pub=Springer+International+Publishing&rft.issn=1783-7677&rft.eissn=1783-8738&rft.volume=15&rft.issue=4&rft.spage=337&rft.epage=358&rft_id=info:doi/10.1007%2Fs12193-020-00347-7&rft.externalDocID=10_1007_s12193_020_00347_7 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1783-7677&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1783-7677&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1783-7677&client=summon |