Are UX Evaluation Methods Providing the Same Big Picture?

The success of a software application is related to users’ willingness to keep using it. In this sense, evaluating User eXperience (UX) became an important part of the software development process. Researchers have been carrying out studies by employing various methods to evaluate the UX of software...

Full description

Saved in:
Bibliographic Details
Published inSensors (Basel, Switzerland) Vol. 21; no. 10; p. 3480
Main Authors Nakamura, Walter Takashi, Ahmed, Iftekhar, Redmiles, David, Oliveira, Edson, Fernandes, David, de Oliveira, Elaine H. T., Conte, Tayana
Format Journal Article
LanguageEnglish
Published Basel MDPI AG 17.05.2021
MDPI
Subjects
Customer relationship management
Emotions
Evaluation
Feedback
Interviews
long-term user experience
Longitudinal studies
longitudinal UX evaluation
Questionnaires
Researchers
Software
Software development
Usability
User experience
user experience evaluation methods
User interfaces
Online AccessGet full text

Cover

Abstract The success of a software application is related to users’ willingness to keep using it. In this sense, evaluating User eXperience (UX) became an important part of the software development process. Researchers have been carrying out studies by employing various methods to evaluate the UX of software products. Some studies reported varied and even contradictory results when applying different UX evaluation methods, making it difficult for practitioners to identify which results to rely upon. However, these works did not evaluate the developers’ perspectives and their impacts on the decision process. Moreover, such studies focused on one-shot evaluations, which cannot assess whether the methods provide the same big picture of the experience (i.e., deteriorating, improving, or stable). This paper presents a longitudinal study in which 68 students evaluated the UX of an online judge system by employing AttrakDiff, UEQ, and Sentence Completion methods at three moments along a semester. This study reveals contrasting results between the methods, which affected developers’ decisions and interpretations. With this work, we intend to draw the HCI community’s attention to the contrast between different UX evaluation methods and the impact of their outcomes in the software development process.
AbstractList The success of a software application is related to users’ willingness to keep using it. In this sense, evaluating User eXperience (UX) became an important part of the software development process. Researchers have been carrying out studies by employing various methods to evaluate the UX of software products. Some studies reported varied and even contradictory results when applying different UX evaluation methods, making it difficult for practitioners to identify which results to rely upon. However, these works did not evaluate the developers’ perspectives and their impacts on the decision process. Moreover, such studies focused on one-shot evaluations, which cannot assess whether the methods provide the same big picture of the experience (i.e., deteriorating, improving, or stable). This paper presents a longitudinal study in which 68 students evaluated the UX of an online judge system by employing AttrakDiff, UEQ, and Sentence Completion methods at three moments along a semester. This study reveals contrasting results between the methods, which affected developers’ decisions and interpretations. With this work, we intend to draw the HCI community’s attention to the contrast between different UX evaluation methods and the impact of their outcomes in the software development process.
Author Redmiles, David
Conte, Tayana
Oliveira, Edson
Nakamura, Walter Takashi
de Oliveira, Elaine H. T.
Ahmed, Iftekhar
Fernandes, David
AuthorAffiliation 1 Institute of Computing (IComp), Federal University of Amazonas (UFAM), Avenida Rodrigo Otávio 6200, Manaus 69067-005, Brazil; david@icomp.ufam.edu.br (D.F.); elaine@icomp.ufam.edu.br (E.H.T.d.O.); tayana@icomp.ufam.edu.br (T.C.)
2 Department of Informatics, University of California Irvine (UCI), Irvine, CA 92697, USA; iftekha@uci.edu (I.A.); redmiles@ics.uci.edu (D.R.)
3 Secretaria de Estado da Fazenda do Amazonas–SEFAZ/AM, Avenida Andre Araujo 150, Manaus 69060-000, Brazil; edson.cesar@sefaz.am.gov.br
AuthorAffiliation_xml – name: 2 Department of Informatics, University of California Irvine (UCI), Irvine, CA 92697, USA; iftekha@uci.edu (I.A.); redmiles@ics.uci.edu (D.R.)
– name: 1 Institute of Computing (IComp), Federal University of Amazonas (UFAM), Avenida Rodrigo Otávio 6200, Manaus 69067-005, Brazil; david@icomp.ufam.edu.br (D.F.); elaine@icomp.ufam.edu.br (E.H.T.d.O.); tayana@icomp.ufam.edu.br (T.C.)
– name: 3 Secretaria de Estado da Fazenda do Amazonas–SEFAZ/AM, Avenida Andre Araujo 150, Manaus 69060-000, Brazil; edson.cesar@sefaz.am.gov.br
Author_xml – sequence: 1
  givenname: Walter Takashi
  surname: Nakamura
  fullname: Nakamura, Walter Takashi
– sequence: 2
  givenname: Iftekhar
  surname: Ahmed
  fullname: Ahmed, Iftekhar
– sequence: 3
  givenname: David
  surname: Redmiles
  fullname: Redmiles, David
– sequence: 4
  givenname: Edson
  surname: Oliveira
  fullname: Oliveira, Edson
– sequence: 5
  givenname: David
  surname: Fernandes
  fullname: Fernandes, David
– sequence: 6
  givenname: Elaine H. T.
  surname: de Oliveira
  fullname: de Oliveira, Elaine H. T.
– sequence: 7
  givenname: Tayana
  surname: Conte
  fullname: Conte, Tayana
BookMark eNpdkU1rGzEQhkVJiOM0h_6DhV7agxN9r3RpSU2-ICGBNtCb0EojW2a9SqVdQ_99NnEIcU4zzDw8DPNO0V6XOkDoC8EnjGl8WighmHGFP6FDwimfKUrx3rt-gqalrDCmjDF1gCaMY1lLjg-RPstQPfytzje2HWwfU1fdQr9MvlT3OW2ij92i6pdQ_bZrqH7FRXUfXT9k-PkZ7QfbFjh-rUfo4eL8z_xqdnN3eT0_u5k5zmU_k04GSknjiPISB6VkHbCwMigZtHOM6CCUYMACo1iyRnMmQdum8UJJETg7Qtdbr092ZR5zXNv83yQbzcsg5YWxuY-uBaMbSqh3GoR2XIDV3FOtrPaiFkEGMrp-bF2PQ7MG76Drs213pLubLi7NIm2MIkJSUY-Cb6-CnP4NUHqzjsVB29oO0lAMFUxyResaj-jXD-gqDbkbX_VMUV2TWtCR-r6lXE6lZAhvxxBsnsM1b-GyJzotlDY
CitedBy_id crossref_primary_10_3390_fi16030092
crossref_primary_10_3390_s23239570
crossref_primary_10_1093_iwc_iwae002
Cites_doi 10.1002/pri.66
10.1145/1978942.1979336
10.18293/SEKE2018-161
10.1145/1518701.1518813
10.1093/iwc/iww022
10.1145/1868914.1868973
10.1002/bdm.516
10.1016/j.jrp.2013.09.008
10.1145/3377816.3381737
10.1080/10447318.2015.1064648
10.1007/978-3-319-68213-6
10.1016/j.ijhcs.2013.09.006
10.3390/proceedings2019031014
10.1145/3274192.3274201
10.1080/10447318.2015.1065696
10.3390/s18061822
10.1007/s10869-011-9231-8
10.1177/1049732305276687
10.1002/job.1962
10.1016/j.intcom.2010.07.002
10.1145/3290607.3313000
10.3390/s19153251
10.3390/s21041185
10.1007/978-3-319-11866-6_2
10.1145/3160504.3160512
10.1016/j.ijhcs.2017.07.005
10.1016/j.jesp.2015.07.006
10.1007/s11165-016-9602-2
10.1207/S15327663JCP1304_14
10.1016/j.chb.2014.10.048
10.1007/978-3-322-80058-9
10.1007/978-3-642-23765-2
10.1002/hfm.20583
10.1145/3064663.3064770
10.1145/2347504.2347523
10.1007/978-3-540-89350-9
10.1016/j.ijhcs.2013.10.004
10.1007/978-3-642-31000-3
10.1145/3173574.3174035
10.1093/iwc/iwt036
ContentType Journal Article
Copyright 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
2021 by the authors. 2021
Copyright_xml – notice: 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
– notice: 2021 by the authors. 2021
DBID AAYXX
CITATION
3V.
7X7
7XB
88E
8FI
8FJ
8FK
ABUWG
AFKRA
AZQEC
BENPR
CCPQU
DWQXO
FYUFA
GHDGH
K9.
M0S
M1P
PIMPY
PQEST
PQQKQ
PQUKI
PRINS
7X8
5PM
DOA
DOI 10.3390/s21103480
DatabaseName CrossRef
ProQuest Central (Corporate)
Health & Medical Collection
ProQuest Central (purchase pre-March 2016)
Medical Database (Alumni Edition)
Hospital Premium Collection
Hospital Premium Collection (Alumni Edition)
ProQuest Central (Alumni) (purchase pre-March 2016)
ProQuest Central (Alumni)
ProQuest Central
ProQuest Central Essentials
ProQuest Databases
ProQuest One Community College
ProQuest Central Korea
Health Research Premium Collection
Health Research Premium Collection (Alumni)
ProQuest Health & Medical Complete (Alumni)
Health & Medical Collection (Alumni Edition)
Medical Database
Publicly Available Content Database
ProQuest One Academic Eastern Edition (DO NOT USE)
ProQuest One Academic
ProQuest One Academic UKI Edition
ProQuest Central China
MEDLINE - Academic
PubMed Central (Full Participant titles)
DOAJ Directory of Open Access Journals
DatabaseTitle CrossRef
Publicly Available Content Database
ProQuest Central Essentials
ProQuest One Academic Eastern Edition
ProQuest Health & Medical Complete (Alumni)
ProQuest Central (Alumni Edition)
ProQuest One Community College
ProQuest Hospital Collection
Health Research Premium Collection (Alumni)
ProQuest Central China
ProQuest Hospital Collection (Alumni)
ProQuest Central
ProQuest Health & Medical Complete
Health Research Premium Collection
ProQuest Medical Library
ProQuest One Academic UKI Edition
Health and Medicine Complete (Alumni Edition)
ProQuest Central Korea
ProQuest One Academic
ProQuest Medical Library (Alumni)
ProQuest Central (Alumni)
MEDLINE - Academic
DatabaseTitleList
CrossRef

Publicly Available Content Database
Database_xml – sequence: 1
  dbid: DOA
  name: DOAJ: Directory of Open Access Journals
  url: https://www.doaj.org/
  sourceTypes: Open Website
– sequence: 2
  dbid: 7X7
  name: Health & Medical Collection
  url: https://search.proquest.com/healthcomplete
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
EISSN 1424-8220
ExternalDocumentID oai_doaj_org_article_9b212dc9e59c45ea94d298a9d575f6f1
10_3390_s21103480
GroupedDBID ---
123
2WC
3V.
53G
5VS
7X7
88E
8FE
8FG
8FI
8FJ
AADQD
AAHBH
AAYXX
ABDBF
ABJCF
ABUWG
ADBBV
AENEX
AFKRA
AFZYC
ALIPV
ALMA_UNASSIGNED_HOLDINGS
ARAPS
BENPR
BPHCQ
BVXVI
CCPQU
CITATION
CS3
D1I
DU5
E3Z
EBD
ESX
F5P
FYUFA
GROUPED_DOAJ
GX1
HCIFZ
HH5
HMCUK
HYE
IAO
ITC
KB.
KQ8
L6V
M1P
M48
M7S
MODMG
M~E
OK1
P2P
P62
PDBOC
PIMPY
PQQKQ
PROAC
PSQYO
RIG
RNS
RPM
TUS
UKHRP
XSB
~8M
7XB
8FK
AZQEC
DWQXO
K9.
PQEST
PQUKI
PRINS
7X8
5PM
ID FETCH-LOGICAL-c446t-6c6f221bc18d60f8867f05a6f86f9cc319f5853e3f32063b9436e9abbd5865f43
IEDL.DBID RPM
ISSN 1424-8220
IngestDate Fri Oct 04 13:11:06 EDT 2024
Tue Sep 17 21:24:28 EDT 2024
Fri Jun 28 15:05:54 EDT 2024
Thu Oct 10 16:15:30 EDT 2024
Thu Sep 26 21:15:43 EDT 2024
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 10
Language English
License Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c446t-6c6f221bc18d60f8867f05a6f86f9cc319f5853e3f32063b9436e9abbd5865f43
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
OpenAccessLink https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8156257/
PMID 34067640
PQID 2532971752
PQPubID 2032333
ParticipantIDs doaj_primary_oai_doaj_org_article_9b212dc9e59c45ea94d298a9d575f6f1
pubmedcentral_primary_oai_pubmedcentral_nih_gov_8156257
proquest_miscellaneous_2536482770
proquest_journals_2532971752
crossref_primary_10_3390_s21103480
PublicationCentury 2000
PublicationDate 20210517
PublicationDateYYYYMMDD 2021-05-17
PublicationDate_xml – month: 5
  year: 2021
  text: 20210517
  day: 17
PublicationDecade 2020
PublicationPlace Basel
PublicationPlace_xml – name: Basel
PublicationTitle Sensors (Basel, Switzerland)
PublicationYear 2021
Publisher MDPI AG
MDPI
Publisher_xml – name: MDPI AG
– name: MDPI
References ref_50
ref_14
ref_12
ref_11
Michalco (ref_25) 2015; 31
Huang (ref_39) 2012; 27
ref_19
ref_18
ref_17
Law (ref_49) 2014; 72
ref_15
Kim (ref_20) 2015; 25
Ling (ref_16) 2011; 23
DeSimone (ref_38) 2015; 36
Nakamura (ref_8) 2019; 27
Sheldon (ref_42) 1996; 1
Taber (ref_40) 2018; 48
Borsci (ref_10) 2015; 31
ref_24
Curran (ref_37) 2016; 66
Schrepp (ref_44) 2017; 4
ref_23
ref_22
ref_21
Lallemand (ref_51) 2015; 43
ref_28
ref_27
ref_26
Maniaci (ref_36) 2014; 48
ref_34
Cockburn (ref_3) 2017; 108
Hassenzahl (ref_32) 2007; 10
ref_31
ref_30
Zauberman (ref_45) 2006; 19
Kujala (ref_33) 2013; 26
Ardito (ref_5) 2014; 72
Iacobucci (ref_41) 2003; 13
Hsieh (ref_43) 2005; 15
Lallemand (ref_13) 2017; 12
ref_47
ref_46
Santoso (ref_29) 2016; 13
ref_1
Soley (ref_35) 2008; 26
ref_2
ref_48
ref_9
ref_4
ref_7
ref_6
References_xml – volume: 1
  start-page: 221
  year: 1996
  ident: ref_42
  article-title: The use and interpretation of the friedman test in the analysis of ordinal-scale data in repeated measures designs
  publication-title: Physiother. Res. Int.
  doi: 10.1002/pri.66
  contributor:
    fullname: Sheldon
– ident: ref_1
  doi: 10.1145/1978942.1979336
– ident: ref_7
  doi: 10.18293/SEKE2018-161
– ident: ref_2
  doi: 10.1145/1518701.1518813
– ident: ref_21
  doi: 10.1093/iwc/iww022
– ident: ref_23
  doi: 10.1145/1868914.1868973
– volume: 19
  start-page: 191
  year: 2006
  ident: ref_45
  article-title: Hedonic versus informational evaluations: Task dependent preferences for sequences of outcomes
  publication-title: J. Behav. Decis. Making
  doi: 10.1002/bdm.516
  contributor:
    fullname: Zauberman
– volume: 48
  start-page: 61
  year: 2014
  ident: ref_36
  article-title: Caring about carelessness: Participant inattention and its effects on research
  publication-title: J. Res. Pers.
  doi: 10.1016/j.jrp.2013.09.008
  contributor:
    fullname: Maniaci
– ident: ref_50
  doi: 10.1145/3377816.3381737
– volume: 31
  start-page: 484
  year: 2015
  ident: ref_10
  article-title: Assessing user satisfaction in the era of user experience: Comparison of the SUS, UMUX, and UMUX-LITE as a function of product experience
  publication-title: Int. J. Human Comput. Interact.
  doi: 10.1080/10447318.2015.1064648
  contributor:
    fullname: Borsci
– ident: ref_34
  doi: 10.1007/978-3-319-68213-6
– volume: 72
  start-page: 526
  year: 2014
  ident: ref_49
  article-title: Attitudes towards user experience (UX) measurement
  publication-title: Int. J. Human Comput. Stud.
  doi: 10.1016/j.ijhcs.2013.09.006
  contributor:
    fullname: Law
– ident: ref_24
  doi: 10.3390/proceedings2019031014
– ident: ref_9
  doi: 10.1145/3274192.3274201
– volume: 27
  start-page: 104
  year: 2019
  ident: ref_8
  article-title: Are scale-based techniques enough for learners to convey their UX when using a learning management system?
  publication-title: Rev. Bras. Inf. Educ.
  contributor:
    fullname: Nakamura
– volume: 10
  start-page: 10
  year: 2007
  ident: ref_32
  article-title: The hedonic/pragmatic model of user experience
  publication-title: UX Manif.
  contributor:
    fullname: Hassenzahl
– volume: 31
  start-page: 603
  year: 2015
  ident: ref_25
  article-title: An exploration of the relation between expectations and user experience
  publication-title: Int. J. Human Comput. Interact.
  doi: 10.1080/10447318.2015.1065696
  contributor:
    fullname: Michalco
– ident: ref_27
  doi: 10.3390/s18061822
– volume: 27
  start-page: 99
  year: 2012
  ident: ref_39
  article-title: Detecting and deterring insufficient effort responding to surveys
  publication-title: J. Bus. Psychol.
  doi: 10.1007/s10869-011-9231-8
  contributor:
    fullname: Huang
– volume: 4
  start-page: 103
  year: 2017
  ident: ref_44
  article-title: Design and evaluation of a short version of the user experience questionnaire (UEQ-S)
  publication-title: Int. J. Interact. Multimed. Artif. Intell.
  contributor:
    fullname: Schrepp
– volume: 15
  start-page: 1277
  year: 2005
  ident: ref_43
  article-title: Three approaches to qualitative content analysis
  publication-title: Qual. Health Res.
  doi: 10.1177/1049732305276687
  contributor:
    fullname: Hsieh
– volume: 36
  start-page: 171
  year: 2015
  ident: ref_38
  article-title: Best practice recommendations for data screening: Data screening
  publication-title: J. Organ. Behav.
  doi: 10.1002/job.1962
  contributor:
    fullname: DeSimone
– volume: 23
  start-page: 18
  year: 2011
  ident: ref_16
  article-title: An integrated model of interaction experience for information retrieval in a web-based encyclopaedia
  publication-title: Interact. Comput.
  doi: 10.1016/j.intcom.2010.07.002
  contributor:
    fullname: Ling
– ident: ref_17
– ident: ref_48
  doi: 10.1145/3290607.3313000
– ident: ref_30
  doi: 10.3390/s19153251
– ident: ref_28
– ident: ref_26
  doi: 10.3390/s21041185
– ident: ref_31
  doi: 10.1007/978-3-319-11866-6_2
– ident: ref_6
  doi: 10.1145/3160504.3160512
– ident: ref_47
– volume: 108
  start-page: 89
  year: 2017
  ident: ref_3
  article-title: The effects of interaction sequencing on user experience and preference
  publication-title: Int. J. Human Comput. Stud.
  doi: 10.1016/j.ijhcs.2017.07.005
  contributor:
    fullname: Cockburn
– ident: ref_11
– volume: 26
  start-page: 223
  year: 2008
  ident: ref_35
  article-title: Projective techniques for social science and business research
  publication-title: J. Consum. Mark.
  contributor:
    fullname: Soley
– volume: 66
  start-page: 4
  year: 2016
  ident: ref_37
  article-title: Methods for the detection of carelessly invalid responses in survey data
  publication-title: J. Exp. Soc. Psychol.
  doi: 10.1016/j.jesp.2015.07.006
  contributor:
    fullname: Curran
– volume: 48
  start-page: 1273
  year: 2018
  ident: ref_40
  article-title: The use of cronbach’s α when developing and reporting research instruments in science education
  publication-title: Res. Sci. Educ.
  doi: 10.1007/s11165-016-9602-2
  contributor:
    fullname: Taber
– volume: 12
  start-page: 22
  year: 2017
  ident: ref_13
  article-title: Lab testing beyond usability: Challenges and recommendations for assessing user experiences
  publication-title: J. Usability Stud.
  contributor:
    fullname: Lallemand
– volume: 13
  start-page: 58
  year: 2016
  ident: ref_29
  article-title: Measuring user experience of the student-centered e-learning environment
  publication-title: J. Educ. Online
  contributor:
    fullname: Santoso
– volume: 13
  start-page: 478
  year: 2003
  ident: ref_41
  article-title: Advancing α: Measuring reliability with confidence
  publication-title: J. Consum. Psychol.
  doi: 10.1207/S15327663JCP1304_14
  contributor:
    fullname: Iacobucci
– volume: 43
  start-page: 35
  year: 2015
  ident: ref_51
  article-title: User experience: A concept without consensus? Exploring practitioners’ Perspectives through an international survey
  publication-title: Comput. Human Behav.
  doi: 10.1016/j.chb.2014.10.048
  contributor:
    fullname: Lallemand
– ident: ref_14
  doi: 10.1007/978-3-322-80058-9
– ident: ref_22
  doi: 10.1007/978-3-642-23765-2
– volume: 25
  start-page: 659
  year: 2015
  ident: ref_20
  article-title: How user experience changes over time: A case study of social network services: How user experience changes over time
  publication-title: Human Fact. Ergon. Manuf. Serv. Ind.
  doi: 10.1002/hfm.20583
  contributor:
    fullname: Kim
– ident: ref_12
  doi: 10.1145/3064663.3064770
– ident: ref_19
  doi: 10.1145/2347504.2347523
– ident: ref_15
  doi: 10.1007/978-3-540-89350-9
– ident: ref_46
– volume: 72
  start-page: 542
  year: 2014
  ident: ref_5
  article-title: Investigating and promoting UX practice in industry: An experimental study
  publication-title: Int. J. Human Comput. Stud.
  doi: 10.1016/j.ijhcs.2013.10.004
  contributor:
    fullname: Ardito
– ident: ref_18
  doi: 10.1007/978-3-642-31000-3
– ident: ref_4
  doi: 10.1145/3173574.3174035
– volume: 26
  start-page: 238
  year: 2013
  ident: ref_33
  article-title: Sentence completion for understanding users and evaluating user experience
  publication-title: Interact. Comput.
  doi: 10.1093/iwc/iwt036
  contributor:
    fullname: Kujala
SSID ssj0023338
Score 2.4327836
Snippet The success of a software application is related to users’ willingness to keep using it. In this sense, evaluating User eXperience (UX) became an important...
SourceID doaj
pubmedcentral
proquest
crossref
SourceType Open Website
Open Access Repository
Aggregation Database
StartPage 3480
SubjectTerms Customer relationship management
Emotions
Evaluation
Feedback
Interviews
long-term user experience
Longitudinal studies
longitudinal UX evaluation
Questionnaires
Researchers
Software
Software development
Usability
User experience
user experience evaluation methods
User interfaces
SummonAdditionalLinks – databaseName: DOAJ Directory of Open Access Journals
  dbid: DOA
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1LSwMxEA7Skx7EJ1arRPG6tM1rk5O00lIEpaCF3pYkm2gPbqWP_-8kuy27Jy9eN1mYnUkm30dmv0HoUTmntZAsIUr7JLS4SoxJbeK8ksCHDGTAqPb5JiYz9jLn81qrr1ATVsoDl47rKgPJNbfKcWUZd1qxnCipVQ44wwtfEp8-35GpimpRYF6ljhAFUt9dB5pDWdB-rJ0-UaS_gSybdZG1g2Z8go4rhIgHpWWn6MAVZ-iopht4jtRg5fBsjkd7qW78GjtBr_E0_lkHszAgO_yuvx0eLj7xdBGvCp4u0Gw8-nieJFUPhMQCUdskwgpPSN_YvsxFz0spUt_jWngpvLIWNpAHwE8d9ZQA2jCKUeGUNibnUnDP6CVqFcvCXSEsJSe5YdSkhjOWporDS7TX04w5yaxto4edb7KfUuoiA4oQHJjtHdhGw-C1_YSgTh0fQMyyKmbZXzFro87O51m1ZdYZ4ZQoIJectNH9fhgWe7jB0IVbbuMcEXRLU7AjbcSqYVBzpFh8RdnsoIsDCer6P77gBh2SUNwSZFzTDmptVlt3C-hkY-7iQvwFjRzitg
  priority: 102
  providerName: Directory of Open Access Journals
– databaseName: ProQuest Technology Collection
  dbid: 8FG
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1JTwMhFCZaL3owrrFuQeN10pZt4NRUYzUmGhNt0tsEGKg9OK1d_r8POh07F68DZMh78Pg-lu8hdKec01pIlhClfRJSXCXGpDZxXkngQwYiYFT7fBPPA_Yy5MNyw21eXqtcx8QYqPOJDXvkLcIpUcA9OOlOf5KQNSqcrpYpNLbRTico4YWX4v2ninBR4F8rNSEK1L41D2SHsqAAubEGRan-Gr6s347cWG76B2i_xIm4t3LsIdpyxRHa21APPEaqN3N4MMSPlWA3fo35oOf4Pb6vg1oY8B3-0N8O349H-H0cDwy6J2jQf_x8eE7KTAiJBbq2SIQVnpCOsR2Zi7aXUqS-zbXwUnhlLUwjD7CfOuopAcxhFKPCKW1MzqXgntFT1CgmhTtDWEpOcsOoSQ1nLE0Vh0a03daMOcmsbaLbtW2y6UrwIgOiEAyYVQZsovtgtapC0KiOHyazUVYO-UwZWBZzqxxXlnGnFcuJklrlgBC98J0mulzbPCsnzjz7c3MT3VTFMOTDOYYu3GQZ64igXppCP9Kar2odqpcU468onh3UcSBMnf__8wu0S8LllSDTml6ixmK2dFeAPhbmOg6xX63R2e8
  priority: 102
  providerName: ProQuest
– databaseName: Scholars Portal Open Access Journals
  dbid: M48
  link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LSwMxEA5SL3oQn1hfRPG6us1rk4OIlRYRKoIWeluSbKIF3WpbQf-9k7RduuDB62YC2clMZj4m-Qahc-Wc1kKyhCjtk9DiKjEms4nzSgIeMnACRrbPB3HXZ_cDPlhBix6bcwVO_oR2oZ9Uf_x28f35cw0OfxUQJ0D2y0kAMZRJQO6rhFEWDL3HqmICoTQ2tA5vuhKIh-mMYKg-tRaWInt_LeWsX5hcikDdTbQxTx3xzWyvt9CKK7fR-hKh4A5SN2OH-wPcqTi8cS-2iJ7gx_jkDqQwpHz4Sb873B6-4MdhrCFc76J-t_N8e5fMmyMkFhDcNBFWeEJaxrZkIVIvpch8yrXwUnhlLXiWByRAHfWUQBpiFKPCKW1MwaXgntE91ChHpdtHWEpOCsOoyQxnLMsUh0k0TTVjTjJrm-hsoZv8Y8aBkQN2CArMKwU2UTtorRIItNXxw2j8ks-9IFcGImVhlePKMu60YgVRUqsCkkYvfKuJjhY6zxemkBNOiQLUyUkTnVbD4AWhtKFLN_qKMiIQmmawjqy2V7UF1UfK4Wvk0w6EOXByHfznNw_RGgm3WgJ_a3aEGtPxlzuGtGRqTqLR_QLN0t6P
  priority: 102
  providerName: Scholars Portal
Title Are UX Evaluation Methods Providing the Same Big Picture?
URI https://www.proquest.com/docview/2532971752
https://search.proquest.com/docview/2536482770
https://pubmed.ncbi.nlm.nih.gov/PMC8156257
https://doaj.org/article/9b212dc9e59c45ea94d298a9d575f6f1
Volume 21
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1NaxsxEB2S9NIeSj-p29SopdeNbX3rVOJgNxQcTFuDb4uklRJDvQ628_87kneN99rLHlYSiNFo573V6A3ANxOCtVLzghobi1TiqnBO-SJEo5EPOfwCZrXPO3m74D-XYnkGor0Lk5P2vVtd1X_XV_XqIedWPq79oM0TG8xnN0nhBF1tcA7nirGWojcsiyHpOkgIMeTzg11iOIzrVPKNYfRSMv3nOIlBWaq_gy-72ZEn4Wb6Cl42OJFcH-bzGs5C_QZenKgHvgVzvQ1ksSSTo2A3meV60Dsyz_frsBdBfEd-23Ug49U9ma_ygcH3d7CYTv7c3BZNJYTCI13bF9LLSOnI-ZGu5DBqLVUcCiujltF4j9soIuxngUVGEXM4w5kMxjpXCS1F5Ow9XNSbOnwAorWglePMKSc4V8oIHMSGQ8t50Nz7HnxtbVM-HgQvSiQKyZbl0ZY9GCerHTskjer8YrO9L5uVKo3DsFh5E4TxXARreEWNtqZChBhlHPXgsrV52WycXUkFowYppqA9-HJsRpdP5xi2Dpun3Ecm9VKF81CdtepMqNuCvpTFsxvf-fjfIz_Bc5ryWpKCq7qEi_32KXxGYLJ3fXTHpcKnnv7ow7Px5G7-q59JPj5nXPezo_4DuJvoGw
link.rule.ids 230,315,733,786,790,870,891,2115,2236,12083,12792,21416,24346,27955,27956,31752,31753,33406,33407,33777,33778,43343,43633,43838,53825,53827,74100,74390,74657
linkProvider National Library of Medicine
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1NTxsxEB214dD2UBXailBaXNTrisRfa58QqYLSFqIIiJTbyvbakAMbmoT_z9jZbLOXXtezWmtsz7xne98A_NDeGyMVz6g2IYslrjJrc5f5oBXyIYsRMKl9juVoyn_PxKzecFvV1yq3MTEF6nLh4h75GRWMauQegp4__c1i1ah4ulqX0HgNe1FyU3VgbzAcT24aysWQgW30hBiS-7NVpDuMRw3InSyUxPpbCLN9P3In4Vx-gPc1UiQXm6Hdh1e-OoB3O_qBH0FfLD2Zzsiwkewm16ki9IpM0h92aEUQ4ZFb8-jJYH5PJvN0ZHD-CaaXw7ufo6yuhZA5JGzrTDoZKO1b11el7AWlZB56wsigZNDO4UIKCPyZZ4FRRB1Wcya9NtaWQkkROPsMnWpR-UMgSglaWs5sbgXnea4FvsR6PcO5V9y5LpxufVM8bSQvCqQK0YFF48AuDKLXGoOoUp0eLJb3RT3pC20xMZZOe6EdF95oXlKtjC4RIwYZ-l043vq8qJfOqvg30F343jTjpI8nGabyi-dkI6N-aY79yFtj1epQu6WaPyT57KiPg4Hq6P8fP4E3o7vrq-Lq1_jPF3hL41WWKNqaH0NnvXz2XxGLrO23esK9ANGQ3kY
linkToPdf http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1LbxMxEB5BkSp6QLQFESjURVxX2fjtU9VCo76oIkGk3Fa21y45dFOS9P8zdjZp9sJ17dVa4_HMfDvjbwC-mRCslZoX1NhYpBZXhXPKFyEajXjIoQXMbJ938nLMrydi0tY_LdqyyrVNzIa6nvn0j7xPBaMGsYeg_diWRYx-DE8f_xapg1TKtLbtNF7CK_SSZWrjoCbP4IshFlsxCzGE-f1FAj6MJzbILX-Uafs7sWa3UnLL9Qzfwps2ZiRnq03ehxehOYC9LSbBQzBn80DGE3KxIe8mP3Nv6AUZ5bt2OItgrEd-2YdAzqf3ZDTNyYPTdzAeXvz-flm0XREKj9BtWUgvI6UD5we6lmXUWqpYCiujltF4j0cqIgRggUVGMf5whjMZjHWuFlqKyNl72GlmTfgARGtBa8eZU05wrpQR-BIrS8t50Nz7Hnxdy6Z6XJFfVAgakgCrjQB7cJ6ktpmQ-Krzg9n8vmrVvzIOXWTtTRDGcxGs4TU12poao8Uo46AHR2uZV-0hWlTPW96Dk80wqn_KadgmzJ7yHJmYTBWuQ3X2qrOg7kgz_ZOJtBNTDpqsj___-DHsoqZVt1d3N5_gNU01LYm9VR3BznL-FD5jULJ0X7K2_QMhiuED
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Are+UX+Evaluation+Methods+Providing+the+Same+Big+Picture%3F&rft.jtitle=Sensors+%28Basel%2C+Switzerland%29&rft.au=Nakamura%2C+Walter+Takashi&rft.au=Ahmed%2C+Iftekhar&rft.au=Redmiles%2C+David&rft.au=Oliveira%2C+Edson&rft.date=2021-05-17&rft.issn=1424-8220&rft.eissn=1424-8220&rft.volume=21&rft.issue=10&rft.spage=3480&rft_id=info:doi/10.3390%2Fs21103480&rft.externalDBID=n%2Fa&rft.externalDocID=10_3390_s21103480
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1424-8220&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1424-8220&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1424-8220&client=summon