Are UX Evaluation Methods Providing the Same Big Picture?
The success of a software application is related to users’ willingness to keep using it. In this sense, evaluating User eXperience (UX) became an important part of the software development process. Researchers have been carrying out studies by employing various methods to evaluate the UX of software...
Saved in:
Published in | Sensors (Basel, Switzerland) Vol. 21; no. 10; p. 3480 |
---|---|
Main Authors | , , , , , , |
Format | Journal Article |
Language | English |
Published |
Basel
MDPI AG
17.05.2021
MDPI |
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | The success of a software application is related to users’ willingness to keep using it. In this sense, evaluating User eXperience (UX) became an important part of the software development process. Researchers have been carrying out studies by employing various methods to evaluate the UX of software products. Some studies reported varied and even contradictory results when applying different UX evaluation methods, making it difficult for practitioners to identify which results to rely upon. However, these works did not evaluate the developers’ perspectives and their impacts on the decision process. Moreover, such studies focused on one-shot evaluations, which cannot assess whether the methods provide the same big picture of the experience (i.e., deteriorating, improving, or stable). This paper presents a longitudinal study in which 68 students evaluated the UX of an online judge system by employing AttrakDiff, UEQ, and Sentence Completion methods at three moments along a semester. This study reveals contrasting results between the methods, which affected developers’ decisions and interpretations. With this work, we intend to draw the HCI community’s attention to the contrast between different UX evaluation methods and the impact of their outcomes in the software development process. |
---|---|
AbstractList | The success of a software application is related to users’ willingness to keep using it. In this sense, evaluating User eXperience (UX) became an important part of the software development process. Researchers have been carrying out studies by employing various methods to evaluate the UX of software products. Some studies reported varied and even contradictory results when applying different UX evaluation methods, making it difficult for practitioners to identify which results to rely upon. However, these works did not evaluate the developers’ perspectives and their impacts on the decision process. Moreover, such studies focused on one-shot evaluations, which cannot assess whether the methods provide the same big picture of the experience (i.e., deteriorating, improving, or stable). This paper presents a longitudinal study in which 68 students evaluated the UX of an online judge system by employing AttrakDiff, UEQ, and Sentence Completion methods at three moments along a semester. This study reveals contrasting results between the methods, which affected developers’ decisions and interpretations. With this work, we intend to draw the HCI community’s attention to the contrast between different UX evaluation methods and the impact of their outcomes in the software development process. |
Author | Redmiles, David Conte, Tayana Oliveira, Edson Nakamura, Walter Takashi de Oliveira, Elaine H. T. Ahmed, Iftekhar Fernandes, David |
AuthorAffiliation | 1 Institute of Computing (IComp), Federal University of Amazonas (UFAM), Avenida Rodrigo Otávio 6200, Manaus 69067-005, Brazil; david@icomp.ufam.edu.br (D.F.); elaine@icomp.ufam.edu.br (E.H.T.d.O.); tayana@icomp.ufam.edu.br (T.C.) 2 Department of Informatics, University of California Irvine (UCI), Irvine, CA 92697, USA; iftekha@uci.edu (I.A.); redmiles@ics.uci.edu (D.R.) 3 Secretaria de Estado da Fazenda do Amazonas–SEFAZ/AM, Avenida Andre Araujo 150, Manaus 69060-000, Brazil; edson.cesar@sefaz.am.gov.br |
AuthorAffiliation_xml | – name: 2 Department of Informatics, University of California Irvine (UCI), Irvine, CA 92697, USA; iftekha@uci.edu (I.A.); redmiles@ics.uci.edu (D.R.) – name: 1 Institute of Computing (IComp), Federal University of Amazonas (UFAM), Avenida Rodrigo Otávio 6200, Manaus 69067-005, Brazil; david@icomp.ufam.edu.br (D.F.); elaine@icomp.ufam.edu.br (E.H.T.d.O.); tayana@icomp.ufam.edu.br (T.C.) – name: 3 Secretaria de Estado da Fazenda do Amazonas–SEFAZ/AM, Avenida Andre Araujo 150, Manaus 69060-000, Brazil; edson.cesar@sefaz.am.gov.br |
Author_xml | – sequence: 1 givenname: Walter Takashi surname: Nakamura fullname: Nakamura, Walter Takashi – sequence: 2 givenname: Iftekhar surname: Ahmed fullname: Ahmed, Iftekhar – sequence: 3 givenname: David surname: Redmiles fullname: Redmiles, David – sequence: 4 givenname: Edson surname: Oliveira fullname: Oliveira, Edson – sequence: 5 givenname: David surname: Fernandes fullname: Fernandes, David – sequence: 6 givenname: Elaine H. T. surname: de Oliveira fullname: de Oliveira, Elaine H. T. – sequence: 7 givenname: Tayana surname: Conte fullname: Conte, Tayana |
BookMark | eNpdkU1rGzEQhkVJiOM0h_6DhV7agxN9r3RpSU2-ICGBNtCb0EojW2a9SqVdQ_99NnEIcU4zzDw8DPNO0V6XOkDoC8EnjGl8WighmHGFP6FDwimfKUrx3rt-gqalrDCmjDF1gCaMY1lLjg-RPstQPfytzje2HWwfU1fdQr9MvlT3OW2ij92i6pdQ_bZrqH7FRXUfXT9k-PkZ7QfbFjh-rUfo4eL8z_xqdnN3eT0_u5k5zmU_k04GSknjiPISB6VkHbCwMigZtHOM6CCUYMACo1iyRnMmQdum8UJJETg7Qtdbr092ZR5zXNv83yQbzcsg5YWxuY-uBaMbSqh3GoR2XIDV3FOtrPaiFkEGMrp-bF2PQ7MG76Drs213pLubLi7NIm2MIkJSUY-Cb6-CnP4NUHqzjsVB29oO0lAMFUxyResaj-jXD-gqDbkbX_VMUV2TWtCR-r6lXE6lZAhvxxBsnsM1b-GyJzotlDY |
CitedBy_id | crossref_primary_10_3390_fi16030092 crossref_primary_10_3390_s23239570 crossref_primary_10_1093_iwc_iwae002 |
Cites_doi | 10.1002/pri.66 10.1145/1978942.1979336 10.18293/SEKE2018-161 10.1145/1518701.1518813 10.1093/iwc/iww022 10.1145/1868914.1868973 10.1002/bdm.516 10.1016/j.jrp.2013.09.008 10.1145/3377816.3381737 10.1080/10447318.2015.1064648 10.1007/978-3-319-68213-6 10.1016/j.ijhcs.2013.09.006 10.3390/proceedings2019031014 10.1145/3274192.3274201 10.1080/10447318.2015.1065696 10.3390/s18061822 10.1007/s10869-011-9231-8 10.1177/1049732305276687 10.1002/job.1962 10.1016/j.intcom.2010.07.002 10.1145/3290607.3313000 10.3390/s19153251 10.3390/s21041185 10.1007/978-3-319-11866-6_2 10.1145/3160504.3160512 10.1016/j.ijhcs.2017.07.005 10.1016/j.jesp.2015.07.006 10.1007/s11165-016-9602-2 10.1207/S15327663JCP1304_14 10.1016/j.chb.2014.10.048 10.1007/978-3-322-80058-9 10.1007/978-3-642-23765-2 10.1002/hfm.20583 10.1145/3064663.3064770 10.1145/2347504.2347523 10.1007/978-3-540-89350-9 10.1016/j.ijhcs.2013.10.004 10.1007/978-3-642-31000-3 10.1145/3173574.3174035 10.1093/iwc/iwt036 |
ContentType | Journal Article |
Copyright | 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. 2021 by the authors. 2021 |
Copyright_xml | – notice: 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. – notice: 2021 by the authors. 2021 |
DBID | AAYXX CITATION 3V. 7X7 7XB 88E 8FI 8FJ 8FK ABUWG AFKRA AZQEC BENPR CCPQU DWQXO FYUFA GHDGH K9. M0S M1P PIMPY PQEST PQQKQ PQUKI PRINS 7X8 5PM DOA |
DOI | 10.3390/s21103480 |
DatabaseName | CrossRef ProQuest Central (Corporate) Health & Medical Collection ProQuest Central (purchase pre-March 2016) Medical Database (Alumni Edition) Hospital Premium Collection Hospital Premium Collection (Alumni Edition) ProQuest Central (Alumni) (purchase pre-March 2016) ProQuest Central (Alumni) ProQuest Central ProQuest Central Essentials ProQuest Databases ProQuest One Community College ProQuest Central Korea Health Research Premium Collection Health Research Premium Collection (Alumni) ProQuest Health & Medical Complete (Alumni) Health & Medical Collection (Alumni Edition) Medical Database Publicly Available Content Database ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Academic ProQuest One Academic UKI Edition ProQuest Central China MEDLINE - Academic PubMed Central (Full Participant titles) DOAJ Directory of Open Access Journals |
DatabaseTitle | CrossRef Publicly Available Content Database ProQuest Central Essentials ProQuest One Academic Eastern Edition ProQuest Health & Medical Complete (Alumni) ProQuest Central (Alumni Edition) ProQuest One Community College ProQuest Hospital Collection Health Research Premium Collection (Alumni) ProQuest Central China ProQuest Hospital Collection (Alumni) ProQuest Central ProQuest Health & Medical Complete Health Research Premium Collection ProQuest Medical Library ProQuest One Academic UKI Edition Health and Medicine Complete (Alumni Edition) ProQuest Central Korea ProQuest One Academic ProQuest Medical Library (Alumni) ProQuest Central (Alumni) MEDLINE - Academic |
DatabaseTitleList | CrossRef Publicly Available Content Database |
Database_xml | – sequence: 1 dbid: DOA name: DOAJ: Directory of Open Access Journals url: https://www.doaj.org/ sourceTypes: Open Website – sequence: 2 dbid: 7X7 name: Health & Medical Collection url: https://search.proquest.com/healthcomplete sourceTypes: Aggregation Database |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Engineering |
EISSN | 1424-8220 |
ExternalDocumentID | oai_doaj_org_article_9b212dc9e59c45ea94d298a9d575f6f1 10_3390_s21103480 |
GroupedDBID | --- 123 2WC 3V. 53G 5VS 7X7 88E 8FE 8FG 8FI 8FJ AADQD AAHBH AAYXX ABDBF ABJCF ABUWG ADBBV AENEX AFKRA AFZYC ALIPV ALMA_UNASSIGNED_HOLDINGS ARAPS BENPR BPHCQ BVXVI CCPQU CITATION CS3 D1I DU5 E3Z EBD ESX F5P FYUFA GROUPED_DOAJ GX1 HCIFZ HH5 HMCUK HYE IAO ITC KB. KQ8 L6V M1P M48 M7S MODMG M~E OK1 P2P P62 PDBOC PIMPY PQQKQ PROAC PSQYO RIG RNS RPM TUS UKHRP XSB ~8M 7XB 8FK AZQEC DWQXO K9. PQEST PQUKI PRINS 7X8 5PM |
ID | FETCH-LOGICAL-c446t-6c6f221bc18d60f8867f05a6f86f9cc319f5853e3f32063b9436e9abbd5865f43 |
IEDL.DBID | RPM |
ISSN | 1424-8220 |
IngestDate | Fri Oct 04 13:11:06 EDT 2024 Tue Sep 17 21:24:28 EDT 2024 Fri Jun 28 15:05:54 EDT 2024 Thu Oct 10 16:15:30 EDT 2024 Thu Sep 26 21:15:43 EDT 2024 |
IsDoiOpenAccess | true |
IsOpenAccess | true |
IsPeerReviewed | true |
IsScholarly | true |
Issue | 10 |
Language | English |
License | Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-c446t-6c6f221bc18d60f8867f05a6f86f9cc319f5853e3f32063b9436e9abbd5865f43 |
Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 |
OpenAccessLink | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8156257/ |
PMID | 34067640 |
PQID | 2532971752 |
PQPubID | 2032333 |
ParticipantIDs | doaj_primary_oai_doaj_org_article_9b212dc9e59c45ea94d298a9d575f6f1 pubmedcentral_primary_oai_pubmedcentral_nih_gov_8156257 proquest_miscellaneous_2536482770 proquest_journals_2532971752 crossref_primary_10_3390_s21103480 |
PublicationCentury | 2000 |
PublicationDate | 20210517 |
PublicationDateYYYYMMDD | 2021-05-17 |
PublicationDate_xml | – month: 5 year: 2021 text: 20210517 day: 17 |
PublicationDecade | 2020 |
PublicationPlace | Basel |
PublicationPlace_xml | – name: Basel |
PublicationTitle | Sensors (Basel, Switzerland) |
PublicationYear | 2021 |
Publisher | MDPI AG MDPI |
Publisher_xml | – name: MDPI AG – name: MDPI |
References | ref_50 ref_14 ref_12 ref_11 Michalco (ref_25) 2015; 31 Huang (ref_39) 2012; 27 ref_19 ref_18 ref_17 Law (ref_49) 2014; 72 ref_15 Kim (ref_20) 2015; 25 Ling (ref_16) 2011; 23 DeSimone (ref_38) 2015; 36 Nakamura (ref_8) 2019; 27 Sheldon (ref_42) 1996; 1 Taber (ref_40) 2018; 48 Borsci (ref_10) 2015; 31 ref_24 Curran (ref_37) 2016; 66 Schrepp (ref_44) 2017; 4 ref_23 ref_22 ref_21 Lallemand (ref_51) 2015; 43 ref_28 ref_27 ref_26 Maniaci (ref_36) 2014; 48 ref_34 Cockburn (ref_3) 2017; 108 Hassenzahl (ref_32) 2007; 10 ref_31 ref_30 Zauberman (ref_45) 2006; 19 Kujala (ref_33) 2013; 26 Ardito (ref_5) 2014; 72 Iacobucci (ref_41) 2003; 13 Hsieh (ref_43) 2005; 15 Lallemand (ref_13) 2017; 12 ref_47 ref_46 Santoso (ref_29) 2016; 13 ref_1 Soley (ref_35) 2008; 26 ref_2 ref_48 ref_9 ref_4 ref_7 ref_6 |
References_xml | – volume: 1 start-page: 221 year: 1996 ident: ref_42 article-title: The use and interpretation of the friedman test in the analysis of ordinal-scale data in repeated measures designs publication-title: Physiother. Res. Int. doi: 10.1002/pri.66 contributor: fullname: Sheldon – ident: ref_1 doi: 10.1145/1978942.1979336 – ident: ref_7 doi: 10.18293/SEKE2018-161 – ident: ref_2 doi: 10.1145/1518701.1518813 – ident: ref_21 doi: 10.1093/iwc/iww022 – ident: ref_23 doi: 10.1145/1868914.1868973 – volume: 19 start-page: 191 year: 2006 ident: ref_45 article-title: Hedonic versus informational evaluations: Task dependent preferences for sequences of outcomes publication-title: J. Behav. Decis. Making doi: 10.1002/bdm.516 contributor: fullname: Zauberman – volume: 48 start-page: 61 year: 2014 ident: ref_36 article-title: Caring about carelessness: Participant inattention and its effects on research publication-title: J. Res. Pers. doi: 10.1016/j.jrp.2013.09.008 contributor: fullname: Maniaci – ident: ref_50 doi: 10.1145/3377816.3381737 – volume: 31 start-page: 484 year: 2015 ident: ref_10 article-title: Assessing user satisfaction in the era of user experience: Comparison of the SUS, UMUX, and UMUX-LITE as a function of product experience publication-title: Int. J. Human Comput. Interact. doi: 10.1080/10447318.2015.1064648 contributor: fullname: Borsci – ident: ref_34 doi: 10.1007/978-3-319-68213-6 – volume: 72 start-page: 526 year: 2014 ident: ref_49 article-title: Attitudes towards user experience (UX) measurement publication-title: Int. J. Human Comput. Stud. doi: 10.1016/j.ijhcs.2013.09.006 contributor: fullname: Law – ident: ref_24 doi: 10.3390/proceedings2019031014 – ident: ref_9 doi: 10.1145/3274192.3274201 – volume: 27 start-page: 104 year: 2019 ident: ref_8 article-title: Are scale-based techniques enough for learners to convey their UX when using a learning management system? publication-title: Rev. Bras. Inf. Educ. contributor: fullname: Nakamura – volume: 10 start-page: 10 year: 2007 ident: ref_32 article-title: The hedonic/pragmatic model of user experience publication-title: UX Manif. contributor: fullname: Hassenzahl – volume: 31 start-page: 603 year: 2015 ident: ref_25 article-title: An exploration of the relation between expectations and user experience publication-title: Int. J. Human Comput. Interact. doi: 10.1080/10447318.2015.1065696 contributor: fullname: Michalco – ident: ref_27 doi: 10.3390/s18061822 – volume: 27 start-page: 99 year: 2012 ident: ref_39 article-title: Detecting and deterring insufficient effort responding to surveys publication-title: J. Bus. Psychol. doi: 10.1007/s10869-011-9231-8 contributor: fullname: Huang – volume: 4 start-page: 103 year: 2017 ident: ref_44 article-title: Design and evaluation of a short version of the user experience questionnaire (UEQ-S) publication-title: Int. J. Interact. Multimed. Artif. Intell. contributor: fullname: Schrepp – volume: 15 start-page: 1277 year: 2005 ident: ref_43 article-title: Three approaches to qualitative content analysis publication-title: Qual. Health Res. doi: 10.1177/1049732305276687 contributor: fullname: Hsieh – volume: 36 start-page: 171 year: 2015 ident: ref_38 article-title: Best practice recommendations for data screening: Data screening publication-title: J. Organ. Behav. doi: 10.1002/job.1962 contributor: fullname: DeSimone – volume: 23 start-page: 18 year: 2011 ident: ref_16 article-title: An integrated model of interaction experience for information retrieval in a web-based encyclopaedia publication-title: Interact. Comput. doi: 10.1016/j.intcom.2010.07.002 contributor: fullname: Ling – ident: ref_17 – ident: ref_48 doi: 10.1145/3290607.3313000 – ident: ref_30 doi: 10.3390/s19153251 – ident: ref_28 – ident: ref_26 doi: 10.3390/s21041185 – ident: ref_31 doi: 10.1007/978-3-319-11866-6_2 – ident: ref_6 doi: 10.1145/3160504.3160512 – ident: ref_47 – volume: 108 start-page: 89 year: 2017 ident: ref_3 article-title: The effects of interaction sequencing on user experience and preference publication-title: Int. J. Human Comput. Stud. doi: 10.1016/j.ijhcs.2017.07.005 contributor: fullname: Cockburn – ident: ref_11 – volume: 26 start-page: 223 year: 2008 ident: ref_35 article-title: Projective techniques for social science and business research publication-title: J. Consum. Mark. contributor: fullname: Soley – volume: 66 start-page: 4 year: 2016 ident: ref_37 article-title: Methods for the detection of carelessly invalid responses in survey data publication-title: J. Exp. Soc. Psychol. doi: 10.1016/j.jesp.2015.07.006 contributor: fullname: Curran – volume: 48 start-page: 1273 year: 2018 ident: ref_40 article-title: The use of cronbach’s α when developing and reporting research instruments in science education publication-title: Res. Sci. Educ. doi: 10.1007/s11165-016-9602-2 contributor: fullname: Taber – volume: 12 start-page: 22 year: 2017 ident: ref_13 article-title: Lab testing beyond usability: Challenges and recommendations for assessing user experiences publication-title: J. Usability Stud. contributor: fullname: Lallemand – volume: 13 start-page: 58 year: 2016 ident: ref_29 article-title: Measuring user experience of the student-centered e-learning environment publication-title: J. Educ. Online contributor: fullname: Santoso – volume: 13 start-page: 478 year: 2003 ident: ref_41 article-title: Advancing α: Measuring reliability with confidence publication-title: J. Consum. Psychol. doi: 10.1207/S15327663JCP1304_14 contributor: fullname: Iacobucci – volume: 43 start-page: 35 year: 2015 ident: ref_51 article-title: User experience: A concept without consensus? Exploring practitioners’ Perspectives through an international survey publication-title: Comput. Human Behav. doi: 10.1016/j.chb.2014.10.048 contributor: fullname: Lallemand – ident: ref_14 doi: 10.1007/978-3-322-80058-9 – ident: ref_22 doi: 10.1007/978-3-642-23765-2 – volume: 25 start-page: 659 year: 2015 ident: ref_20 article-title: How user experience changes over time: A case study of social network services: How user experience changes over time publication-title: Human Fact. Ergon. Manuf. Serv. Ind. doi: 10.1002/hfm.20583 contributor: fullname: Kim – ident: ref_12 doi: 10.1145/3064663.3064770 – ident: ref_19 doi: 10.1145/2347504.2347523 – ident: ref_15 doi: 10.1007/978-3-540-89350-9 – ident: ref_46 – volume: 72 start-page: 542 year: 2014 ident: ref_5 article-title: Investigating and promoting UX practice in industry: An experimental study publication-title: Int. J. Human Comput. Stud. doi: 10.1016/j.ijhcs.2013.10.004 contributor: fullname: Ardito – ident: ref_18 doi: 10.1007/978-3-642-31000-3 – ident: ref_4 doi: 10.1145/3173574.3174035 – volume: 26 start-page: 238 year: 2013 ident: ref_33 article-title: Sentence completion for understanding users and evaluating user experience publication-title: Interact. Comput. doi: 10.1093/iwc/iwt036 contributor: fullname: Kujala |
SSID | ssj0023338 |
Score | 2.4327836 |
Snippet | The success of a software application is related to users’ willingness to keep using it. In this sense, evaluating User eXperience (UX) became an important... |
SourceID | doaj pubmedcentral proquest crossref |
SourceType | Open Website Open Access Repository Aggregation Database |
StartPage | 3480 |
SubjectTerms | Customer relationship management Emotions Evaluation Feedback Interviews long-term user experience Longitudinal studies longitudinal UX evaluation Questionnaires Researchers Software Software development Usability User experience user experience evaluation methods User interfaces |
SummonAdditionalLinks | – databaseName: DOAJ Directory of Open Access Journals dbid: DOA link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1LSwMxEA7Skx7EJ1arRPG6tM1rk5O00lIEpaCF3pYkm2gPbqWP_-8kuy27Jy9eN1mYnUkm30dmv0HoUTmntZAsIUr7JLS4SoxJbeK8ksCHDGTAqPb5JiYz9jLn81qrr1ATVsoDl47rKgPJNbfKcWUZd1qxnCipVQ44wwtfEp8-35GpimpRYF6ljhAFUt9dB5pDWdB-rJ0-UaS_gSybdZG1g2Z8go4rhIgHpWWn6MAVZ-iopht4jtRg5fBsjkd7qW78GjtBr_E0_lkHszAgO_yuvx0eLj7xdBGvCp4u0Gw8-nieJFUPhMQCUdskwgpPSN_YvsxFz0spUt_jWngpvLIWNpAHwE8d9ZQA2jCKUeGUNibnUnDP6CVqFcvCXSEsJSe5YdSkhjOWporDS7TX04w5yaxto4edb7KfUuoiA4oQHJjtHdhGw-C1_YSgTh0fQMyyKmbZXzFro87O51m1ZdYZ4ZQoIJectNH9fhgWe7jB0IVbbuMcEXRLU7AjbcSqYVBzpFh8RdnsoIsDCer6P77gBh2SUNwSZFzTDmptVlt3C-hkY-7iQvwFjRzitg priority: 102 providerName: Directory of Open Access Journals – databaseName: ProQuest Technology Collection dbid: 8FG link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1JTwMhFCZaL3owrrFuQeN10pZt4NRUYzUmGhNt0tsEGKg9OK1d_r8POh07F68DZMh78Pg-lu8hdKec01pIlhClfRJSXCXGpDZxXkngQwYiYFT7fBPPA_Yy5MNyw21eXqtcx8QYqPOJDXvkLcIpUcA9OOlOf5KQNSqcrpYpNLbRTico4YWX4v2ninBR4F8rNSEK1L41D2SHsqAAubEGRan-Gr6s347cWG76B2i_xIm4t3LsIdpyxRHa21APPEaqN3N4MMSPlWA3fo35oOf4Pb6vg1oY8B3-0N8O349H-H0cDwy6J2jQf_x8eE7KTAiJBbq2SIQVnpCOsR2Zi7aXUqS-zbXwUnhlLUwjD7CfOuopAcxhFKPCKW1MzqXgntFT1CgmhTtDWEpOcsOoSQ1nLE0Vh0a03daMOcmsbaLbtW2y6UrwIgOiEAyYVQZsovtgtapC0KiOHyazUVYO-UwZWBZzqxxXlnGnFcuJklrlgBC98J0mulzbPCsnzjz7c3MT3VTFMOTDOYYu3GQZ64igXppCP9Kar2odqpcU468onh3UcSBMnf__8wu0S8LllSDTml6ixmK2dFeAPhbmOg6xX63R2e8 priority: 102 providerName: ProQuest – databaseName: Scholars Portal Open Access Journals dbid: M48 link: http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LSwMxEA5SL3oQn1hfRPG6us1rk4OIlRYRKoIWeluSbKIF3WpbQf-9k7RduuDB62YC2clMZj4m-Qahc-Wc1kKyhCjtk9DiKjEms4nzSgIeMnACRrbPB3HXZ_cDPlhBix6bcwVO_oR2oZ9Uf_x28f35cw0OfxUQJ0D2y0kAMZRJQO6rhFEWDL3HqmICoTQ2tA5vuhKIh-mMYKg-tRaWInt_LeWsX5hcikDdTbQxTx3xzWyvt9CKK7fR-hKh4A5SN2OH-wPcqTi8cS-2iJ7gx_jkDqQwpHz4Sb873B6-4MdhrCFc76J-t_N8e5fMmyMkFhDcNBFWeEJaxrZkIVIvpch8yrXwUnhlLXiWByRAHfWUQBpiFKPCKW1MwaXgntE91ChHpdtHWEpOCsOoyQxnLMsUh0k0TTVjTjJrm-hsoZv8Y8aBkQN2CArMKwU2UTtorRIItNXxw2j8ks-9IFcGImVhlePKMu60YgVRUqsCkkYvfKuJjhY6zxemkBNOiQLUyUkTnVbD4AWhtKFLN_qKMiIQmmawjqy2V7UF1UfK4Wvk0w6EOXByHfznNw_RGgm3WgJ_a3aEGtPxlzuGtGRqTqLR_QLN0t6P priority: 102 providerName: Scholars Portal |
Title | Are UX Evaluation Methods Providing the Same Big Picture? |
URI | https://www.proquest.com/docview/2532971752 https://search.proquest.com/docview/2536482770 https://pubmed.ncbi.nlm.nih.gov/PMC8156257 https://doaj.org/article/9b212dc9e59c45ea94d298a9d575f6f1 |
Volume | 21 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1NaxsxEB2S9NIeSj-p29SopdeNbX3rVOJgNxQcTFuDb4uklRJDvQ628_87kneN99rLHlYSiNFo573V6A3ANxOCtVLzghobi1TiqnBO-SJEo5EPOfwCZrXPO3m74D-XYnkGor0Lk5P2vVtd1X_XV_XqIedWPq79oM0TG8xnN0nhBF1tcA7nirGWojcsiyHpOkgIMeTzg11iOIzrVPKNYfRSMv3nOIlBWaq_gy-72ZEn4Wb6Cl42OJFcH-bzGs5C_QZenKgHvgVzvQ1ksSSTo2A3meV60Dsyz_frsBdBfEd-23Ug49U9ma_ygcH3d7CYTv7c3BZNJYTCI13bF9LLSOnI-ZGu5DBqLVUcCiujltF4j9soIuxngUVGEXM4w5kMxjpXCS1F5Ow9XNSbOnwAorWglePMKSc4V8oIHMSGQ8t50Nz7HnxtbVM-HgQvSiQKyZbl0ZY9GCerHTskjer8YrO9L5uVKo3DsFh5E4TxXARreEWNtqZChBhlHPXgsrV52WycXUkFowYppqA9-HJsRpdP5xi2Dpun3Ecm9VKF81CdtepMqNuCvpTFsxvf-fjfIz_Bc5ryWpKCq7qEi_32KXxGYLJ3fXTHpcKnnv7ow7Px5G7-q59JPj5nXPezo_4DuJvoGw |
link.rule.ids | 230,315,733,786,790,870,891,2115,2236,12083,12792,21416,24346,27955,27956,31752,31753,33406,33407,33777,33778,43343,43633,43838,53825,53827,74100,74390,74657 |
linkProvider | National Library of Medicine |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1NTxsxEB214dD2UBXailBaXNTrisRfa58QqYLSFqIIiJTbyvbakAMbmoT_z9jZbLOXXtezWmtsz7xne98A_NDeGyMVz6g2IYslrjJrc5f5oBXyIYsRMKl9juVoyn_PxKzecFvV1yq3MTEF6nLh4h75GRWMauQegp4__c1i1ah4ulqX0HgNe1FyU3VgbzAcT24aysWQgW30hBiS-7NVpDuMRw3InSyUxPpbCLN9P3In4Vx-gPc1UiQXm6Hdh1e-OoB3O_qBH0FfLD2Zzsiwkewm16ki9IpM0h92aEUQ4ZFb8-jJYH5PJvN0ZHD-CaaXw7ufo6yuhZA5JGzrTDoZKO1b11el7AWlZB56wsigZNDO4UIKCPyZZ4FRRB1Wcya9NtaWQkkROPsMnWpR-UMgSglaWs5sbgXnea4FvsR6PcO5V9y5LpxufVM8bSQvCqQK0YFF48AuDKLXGoOoUp0eLJb3RT3pC20xMZZOe6EdF95oXlKtjC4RIwYZ-l043vq8qJfOqvg30F343jTjpI8nGabyi-dkI6N-aY79yFtj1epQu6WaPyT57KiPg4Hq6P8fP4E3o7vrq-Lq1_jPF3hL41WWKNqaH0NnvXz2XxGLrO23esK9ANGQ3kY |
linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1LbxMxEB5BkSp6QLQFESjURVxX2fjtU9VCo76oIkGk3Fa21y45dFOS9P8zdjZp9sJ17dVa4_HMfDvjbwC-mRCslZoX1NhYpBZXhXPKFyEajXjIoQXMbJ938nLMrydi0tY_LdqyyrVNzIa6nvn0j7xPBaMGsYeg_diWRYx-DE8f_xapg1TKtLbtNF7CK_SSZWrjoCbP4IshFlsxCzGE-f1FAj6MJzbILX-Uafs7sWa3UnLL9Qzfwps2ZiRnq03ehxehOYC9LSbBQzBn80DGE3KxIe8mP3Nv6AUZ5bt2OItgrEd-2YdAzqf3ZDTNyYPTdzAeXvz-flm0XREKj9BtWUgvI6UD5we6lmXUWqpYCiujltF4j0cqIgRggUVGMf5whjMZjHWuFlqKyNl72GlmTfgARGtBa8eZU05wrpQR-BIrS8t50Nz7Hnxdy6Z6XJFfVAgakgCrjQB7cJ6ktpmQ-Krzg9n8vmrVvzIOXWTtTRDGcxGs4TU12poao8Uo46AHR2uZV-0hWlTPW96Dk80wqn_KadgmzJ7yHJmYTBWuQ3X2qrOg7kgz_ZOJtBNTDpqsj___-DHsoqZVt1d3N5_gNU01LYm9VR3BznL-FD5jULJ0X7K2_QMhiuED |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Are+UX+Evaluation+Methods+Providing+the+Same+Big+Picture%3F&rft.jtitle=Sensors+%28Basel%2C+Switzerland%29&rft.au=Nakamura%2C+Walter+Takashi&rft.au=Ahmed%2C+Iftekhar&rft.au=Redmiles%2C+David&rft.au=Oliveira%2C+Edson&rft.date=2021-05-17&rft.issn=1424-8220&rft.eissn=1424-8220&rft.volume=21&rft.issue=10&rft.spage=3480&rft_id=info:doi/10.3390%2Fs21103480&rft.externalDBID=n%2Fa&rft.externalDocID=10_3390_s21103480 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1424-8220&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1424-8220&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1424-8220&client=summon |