Mobile health app usability and quality rating scales: a systematic review

To review the rating scales used to evaluate usability and quality of mobile health applications, and to compare their purpose, content, and intended target users (i.e., patients, caregivers, or researchers). We conducted a systematic review of the literature in accordance with the PRISMA statement...

Full description

Saved in:
Bibliographic Details
Published inDisability and rehabilitation: Assistive technology Vol. 16; no. 7; p. 712
Main Authors Azad-Khaneghah, Peyman, Neubauer, Noelannah, Miguel Cruz, Antonio, Liu, Lili
Format Journal Article
LanguageEnglish
Published England 03.10.2021
Subjects
Online AccessGet more information
ISSN1748-3115
DOI10.1080/17483107.2019.1701103

Cover

Loading…
Abstract To review the rating scales used to evaluate usability and quality of mobile health applications, and to compare their purpose, content, and intended target users (i.e., patients, caregivers, or researchers). We conducted a systematic review of the literature in accordance with the PRISMA statement on Medline, CINAHL, PsycINFO, IEEE Explore databases, as well as a review of the grey literature to identify rating scales used to evaluate usability and quality of mobile health applications (m-health apps), between January 1, 2000 and July 31, 2018. Two researchers screened the titles and abstracts of articles that met inclusion criteria, and retrieved usability and quality rating scales from the articles. We identified 24 usability scales and 25 quality rating scales in 87 peer-reviewed articles. We identified only one quality rating scale designed for non-expert users (i.e., patients or caregivers). None of the studies used a theoretical framework for app evaluation to support the scales. The validity of existing quality rating scales is yet to be investigated. Existing usability and quality rating scales are targeted at professionals, not end users who are patients or caregivers. Rating scales that are usable by all end-users would make mobile health apps accessible and meaningful to consumers.Implications for rehabilitationThe number of mobile health applications on app stores that can be used for rehabilitation is increasing.Most healthcare providers lack the training to identify m-health apps with high quality to be used in rehabilitation.This study has reviewed the current rating scales that can help clinicians and care providers rate the quality of m-health apps and identify the ones that are most appropriate for their practice.
AbstractList To review the rating scales used to evaluate usability and quality of mobile health applications, and to compare their purpose, content, and intended target users (i.e., patients, caregivers, or researchers). We conducted a systematic review of the literature in accordance with the PRISMA statement on Medline, CINAHL, PsycINFO, IEEE Explore databases, as well as a review of the grey literature to identify rating scales used to evaluate usability and quality of mobile health applications (m-health apps), between January 1, 2000 and July 31, 2018. Two researchers screened the titles and abstracts of articles that met inclusion criteria, and retrieved usability and quality rating scales from the articles. We identified 24 usability scales and 25 quality rating scales in 87 peer-reviewed articles. We identified only one quality rating scale designed for non-expert users (i.e., patients or caregivers). None of the studies used a theoretical framework for app evaluation to support the scales. The validity of existing quality rating scales is yet to be investigated. Existing usability and quality rating scales are targeted at professionals, not end users who are patients or caregivers. Rating scales that are usable by all end-users would make mobile health apps accessible and meaningful to consumers.Implications for rehabilitationThe number of mobile health applications on app stores that can be used for rehabilitation is increasing.Most healthcare providers lack the training to identify m-health apps with high quality to be used in rehabilitation.This study has reviewed the current rating scales that can help clinicians and care providers rate the quality of m-health apps and identify the ones that are most appropriate for their practice.
Author Neubauer, Noelannah
Azad-Khaneghah, Peyman
Miguel Cruz, Antonio
Liu, Lili
Author_xml – sequence: 1
  givenname: Peyman
  orcidid: 0000-0002-0263-0634
  surname: Azad-Khaneghah
  fullname: Azad-Khaneghah, Peyman
  organization: Faculty of Rehabilitation Medicine, University of Alberta, Edmonton, AB, Canada
– sequence: 2
  givenname: Noelannah
  surname: Neubauer
  fullname: Neubauer, Noelannah
  organization: Faculty of Rehabilitation Medicine, University of Alberta, Edmonton, AB, Canada
– sequence: 3
  givenname: Antonio
  orcidid: 0000-0003-1618-8733
  surname: Miguel Cruz
  fullname: Miguel Cruz, Antonio
  organization: Faculty of Rehabilitation Medicine, University of Alberta, Edmonton, AB, Canada
– sequence: 4
  givenname: Lili
  surname: Liu
  fullname: Liu, Lili
  organization: Faculty of Applied Health Sciences, University of Waterloo, Waterloo, ON, Canada
BackLink https://www.ncbi.nlm.nih.gov/pubmed/31910687$$D View this record in MEDLINE/PubMed
BookMark eNo1j8tOhEAQRTtG4zz0EzT9A2AVXXSDOzPxmTFudD3pbgoHAwzSjIa_F1-re3IWJ7kLcdjuWhbiDCFGyOACDWUKwcQJYB6jAURQB2L-7SOFmM7EIoQ3ANIJqWMxU5gj6MzMxcPjzlU1yy3bethK23VyH-ykqmGUti3k-97-cG-Hqn2Vwduaw6W0Moxh4GayXvb8UfHniTgqbR349G-X4uXm-nl1F62fbu9XV-vIq5yGyFEJ6FxqGIqU2GtDKZKiHMCUE1nKStbaeZewZcOp1p5R6zT3ujBEyVKc_3a7vWu42HR91dh-3PyfSr4Al09PWg
CitedBy_id crossref_primary_10_2196_30340
crossref_primary_10_1093_jamia_ocab041
crossref_primary_10_1038_s41746_021_00506_4
crossref_primary_10_2196_52179
crossref_primary_10_1093_sxmrev_qead016
crossref_primary_10_1080_09638288_2025_2459895
crossref_primary_10_1016_j_aej_2024_06_002
crossref_primary_10_1134_S0361768822080138
crossref_primary_10_1155_2021_5313027
crossref_primary_10_1177_14713012211065381
crossref_primary_10_3390_jtaer19040162
crossref_primary_10_2196_44469
crossref_primary_10_1080_15323269_2023_2289804
crossref_primary_10_1007_s41669_024_00519_1
crossref_primary_10_2196_36974
crossref_primary_10_3390_healthcare10102068
crossref_primary_10_1146_annurev_publhealth_052020_103738
crossref_primary_10_2196_55790
crossref_primary_10_2196_37980
crossref_primary_10_2196_51076
crossref_primary_10_2196_50839
crossref_primary_10_3390_app12105237
crossref_primary_10_1177_20552076241253539
crossref_primary_10_3390_app13106067
crossref_primary_10_1080_17483107_2024_2409810
crossref_primary_10_3389_ijph_2023_1606413
crossref_primary_10_1186_s12911_024_02738_2
crossref_primary_10_1177_0308022620914464
crossref_primary_10_12968_jowc_2022_31_Sup12_S29
crossref_primary_10_3390_healthcare12111057
crossref_primary_10_3390_ijerph191912956
crossref_primary_10_2196_27037
crossref_primary_10_1186_s12911_023_02252_x
crossref_primary_10_2196_49449
crossref_primary_10_2196_21138
crossref_primary_10_2196_30480
crossref_primary_10_3390_electronics13010213
crossref_primary_10_2196_35538
crossref_primary_10_2196_58616
crossref_primary_10_1093_jamiaopen_ooad051
crossref_primary_10_1177_00084174221085451
crossref_primary_10_1007_s00766_023_00409_8
crossref_primary_10_1016_j_imu_2023_101322
crossref_primary_10_4103_jehp_jehp_1126_21
crossref_primary_10_1186_s12889_025_22102_x
crossref_primary_10_2196_42225
crossref_primary_10_1093_jamia_ocab216
crossref_primary_10_2196_26577
crossref_primary_10_2196_22774
crossref_primary_10_3389_frhs_2024_1372871
crossref_primary_10_1093_jamia_ocad117
crossref_primary_10_2196_59454
crossref_primary_10_1080_10447318_2021_1876361
crossref_primary_10_2196_64525
crossref_primary_10_1093_jbcr_irab197
crossref_primary_10_2196_37521
crossref_primary_10_2196_29441
crossref_primary_10_1007_s10729_023_09647_2
crossref_primary_10_2196_47043
crossref_primary_10_1016_j_urology_2020_08_040
crossref_primary_10_2196_49982
crossref_primary_10_2196_26563
crossref_primary_10_3389_fpubh_2023_1220160
crossref_primary_10_1177_08445621241312394
crossref_primary_10_2196_39590
crossref_primary_10_26633_RPSP_2022_37
ContentType Journal Article
DBID CGR
CUY
CVF
ECM
EIF
NPM
DOI 10.1080/17483107.2019.1701103
DatabaseName Medline
MEDLINE
MEDLINE (Ovid)
MEDLINE
MEDLINE
PubMed
DatabaseTitle MEDLINE
Medline Complete
MEDLINE with Full Text
PubMed
MEDLINE (Ovid)
DatabaseTitleList MEDLINE
Database_xml – sequence: 1
  dbid: NPM
  name: PubMed
  url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 2
  dbid: EIF
  name: MEDLINE
  url: https://proxy.k.utb.cz/login?url=https://www.webofscience.com/wos/medline/basic-search
  sourceTypes: Index Database
DeliveryMethod no_fulltext_linktorsrc
Discipline Occupational Therapy & Rehabilitation
EISSN 1748-3115
ExternalDocumentID 31910687
Genre Research Support, Non-U.S. Gov't
Systematic Review
Journal Article
GroupedDBID ---
00X
03L
04C
0BK
0R~
29G
2QV
34G
36B
39C
4.4
53G
5GY
6PF
AALIY
AALUX
AAMIU
AAPUL
AAQRR
AAWTL
ABBKH
ABEIZ
ABGNL
ABIVO
ABJNI
ABLCE
ABLIJ
ABLKL
ABUPF
ABXYU
ACENM
ACGFS
ACIEZ
ACVOX
ACWGZ
ADBBV
ADCVX
ADOJX
ADRBQ
ADVEQ
ADYSH
AECIN
AEIQB
AEOZL
AEXKJ
AFLJA
AFOSN
AFSUE
AGDLA
AGFJD
AGRBW
AGXXK
AGYJP
AIJEM
AIRBT
AKBVH
ALMA_UNASSIGNED_HOLDINGS
ALQZU
ALYBC
BABNJ
BLEHA
BMSDO
BOHLJ
CCCUG
CGR
COGVJ
CS3
CUY
CVF
DKSSO
EBD
EBS
ECM
ECT
EIF
EIHBH
EJD
F5P
H13
HZ~
KSSTO
KWAYT
KYCEM
LJTGL
M44
M4Z
NPM
O9-
P2P
RNANH
RVRKI
TBQAZ
TDBHL
TERGH
TFDNU
TFL
TFW
TUROJ
V1S
~1N
ID FETCH-LOGICAL-c394t-b4f01bb57e0d54ec674514349007f514a48fe66bcb2eae7e566ce16659c6d7442
IngestDate Wed Feb 19 02:26:04 EST 2025
IsPeerReviewed true
IsScholarly true
Issue 7
Keywords quality evaluation
E-health
rating scales
Mobile applications
mobile health
systematic review
Language English
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-c394t-b4f01bb57e0d54ec674514349007f514a48fe66bcb2eae7e566ce16659c6d7442
ORCID 0000-0003-1618-8733
0000-0002-0263-0634
PMID 31910687
ParticipantIDs pubmed_primary_31910687
PublicationCentury 2000
PublicationDate 2021-10-03
PublicationDateYYYYMMDD 2021-10-03
PublicationDate_xml – month: 10
  year: 2021
  text: 2021-10-03
  day: 03
PublicationDecade 2020
PublicationPlace England
PublicationPlace_xml – name: England
PublicationTitle Disability and rehabilitation: Assistive technology
PublicationTitleAlternate Disabil Rehabil Assist Technol
PublicationYear 2021
SSID ssj0046243
Score 2.4937775
SecondaryResourceType review_article
Snippet To review the rating scales used to evaluate usability and quality of mobile health applications, and to compare their purpose, content, and intended target...
SourceID pubmed
SourceType Index Database
StartPage 712
SubjectTerms Delivery of Health Care
Humans
Mobile Applications
Telemedicine
Title Mobile health app usability and quality rating scales: a systematic review
URI https://www.ncbi.nlm.nih.gov/pubmed/31910687
Volume 16
hasFullText
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1NT9wwELWWIlVcUL-_Kx_aXlahSdaxY26IFiHa3UO1SNyQ7UxgJcgiSFSx_6b_lHEm2c2yUJVerCiWnCjveTwzmnlh7JOOMuNsDkEKaRIIm0FgExsGaC9tqFMNYV1EMxzJ_UNxcJQc9Xp_OlVLVWm33OzOvpL_QRXvIa6-S_YByM4XxRt4jfjiiAjj-E8YD6cWN3XTy-jlwfsVKeaWpKpEHZPXfY-yTxsgHlQCZ1YUnH93vdRvk6VlLpfUvOtUIu6kq7roqFxJze_MTBb8ODUFnJwaStrA9fmChCOorKmIKb6w1hTFIic9nJxUcNbfvaxmjbQB2pxpO_tzUlEe4WzSzVbEVC5HFgzIwirhE7LUwzk3wbJDNdWxp4pqrFfsPBVG-rXQPVW-Qk9veWX5iJ7Vwf7ivAYfLQ0Gv3S2_332lvx2O7XG1pTyln_k00F01AsZi0HbFpaGX-98nw32uF3jVuhSuzDjJ2yziT34DhHpKetB8Yx97upM8zGJTPAv_NcS6M_ZAZGNE9k4ko3PycaRJbwhGyeycSLbNjd8QTVOVHvBDve-j3f3g-ZHHIEbaFEGVuRhZG2iIMwSAU4q4f1sodHBzPHKiDQHKa2zMRhQgCGCg0jKRDuZKSHil-xRMS3gNeORGcRaOAUuzUTopYYwQlE6S0JwWa7FG_aKPtHxBamtHLcf7-29M-_YxoJq79l6jtsbPqCvWNqPNV430QRqJg
linkProvider National Library of Medicine
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Mobile+health+app+usability+and+quality+rating+scales%3A+a+systematic+review&rft.jtitle=Disability+and+rehabilitation%3A+Assistive+technology&rft.au=Azad-Khaneghah%2C+Peyman&rft.au=Neubauer%2C+Noelannah&rft.au=Miguel+Cruz%2C+Antonio&rft.au=Liu%2C+Lili&rft.date=2021-10-03&rft.eissn=1748-3115&rft.volume=16&rft.issue=7&rft.spage=712&rft_id=info:doi/10.1080%2F17483107.2019.1701103&rft_id=info%3Apmid%2F31910687&rft_id=info%3Apmid%2F31910687&rft.externalDocID=31910687