Comparator Data Characteristics and Testing Procedures for the Clinical Performance Evaluation of Continuous Glucose Monitoring Systems

Comparing the performance of different continuous glucose monitoring (CGM) systems is challenging due to the lack of comprehensive guidelines for clinical study design. In particular, the absence of concise requirements for the distribution of comparator (reference) blood glucose (BG) concentrations...

Full description

Saved in:
Bibliographic Details
Published inDiabetes technology & therapeutics
Main Authors Eichenlaub, Manuel, Pleus, Stefan, Rothenbühler, Martina, Bailey, Timothy S, Bally, Lia, Brazg, Ronald, Bruttomesso, Daniela, Diem, Peter, Eriksson Boija, Elisabet, Fokkert, Marion, Haug, Cornelia, Hinzmann, Rolf, Jendle, Johan, Klonoff, David C, Mader, Julia K, Makris, Konstantinos, Moser, Othmar, Nichols, James H, Nørgaard, Kirsten, Pemberton, John, Selvin, Elizabeth, Spanou, Loukia, Thomas, Andreas, Tran, Nam K, Witthauer, Lilian, Slingerland, Robbert J, Freckmann, Guido
Format Journal Article
LanguageEnglish
Published United States Mary Ann Liebert, Inc., publishers 01.04.2024
Subjects
Online AccessGet full text
ISSN1520-9156
1557-8593
DOI10.1089/dia.2023.0465

Cover

Abstract Comparing the performance of different continuous glucose monitoring (CGM) systems is challenging due to the lack of comprehensive guidelines for clinical study design. In particular, the absence of concise requirements for the distribution of comparator (reference) blood glucose (BG) concentrations and their rate of change (RoC) that are used to evaluate CGM performance, impairs comparability. For this article, several experts in the field of CGM performance testing have collaborated to propose characteristics of the distribution of comparator measurements that should be collected during CGM performance testing. Specifically, it is proposed that at least 7.5% of comparator BG concentrations are <70 mg/dL (3.9 mmol/L) and >300 mg/dL (16.7 mmol/L), respectively, and that at least 7.5% of BG-RoC combinations indicate fast BG changes with impending hypo- or hyperglycemia, respectively. These proposed characteristics of the comparator data can facilitate the harmonization of testing conditions across different studies and CGM systems and ensure that the most relevant scenarios representing real-life situations are established during performance testing. In addition, a study protocol and testing procedure for the manipulation of glucose levels are suggested that enable the collection of comparator data with these characteristics. This work is an important step toward establishing a future standard for the performance evaluation of CGM systems.
AbstractList Comparing the performance of different continuous glucose monitoring (CGM) systems is challenging due to the lack of comprehensive guidelines for clinical study design. In particular, the absence of concise requirements for the distribution of comparator (reference) blood glucose (BG) concentrations and their rate of change (RoC) that are used to evaluate CGM performance, impairs comparability. For this article, several experts in the field of CGM performance testing have collaborated to propose characteristics of the distribution of comparator measurements that should be collected during CGM performance testing. Specifically, it is proposed that at least 7.5% of comparator BG concentrations are <70 mg/dL (3.9 mmol/L) and >300 mg/dL (16.7 mmol/L), respectively, and that at least 7.5% of BG-RoC combinations indicate fast BG changes with impending hypo- or hyperglycemia, respectively. These proposed characteristics of the comparator data can facilitate the harmonization of testing conditions across different studies and CGM systems and ensure that the most relevant scenarios representing real-life situations are established during performance testing. In addition, a study protocol and testing procedure for the manipulation of glucose levels are suggested that enable the collection of comparator data with these characteristics. This work is an important step toward establishing a future standard for the performance evaluation of CGM systems.
Author Slingerland, Robbert J
Bally, Lia
Jendle, Johan
Diem, Peter
Eriksson Boija, Elisabet
Bruttomesso, Daniela
Brazg, Ronald
Tran, Nam K
Haug, Cornelia
Hinzmann, Rolf
Mader, Julia K
Rothenbühler, Martina
Pemberton, John
Selvin, Elizabeth
Klonoff, David C
Bailey, Timothy S
Makris, Konstantinos
Witthauer, Lilian
Freckmann, Guido
Moser, Othmar
Eichenlaub, Manuel
Pleus, Stefan
Fokkert, Marion
Nichols, James H
Spanou, Loukia
Nørgaard, Kirsten
Thomas, Andreas
Author_xml – sequence: 1
  givenname: Manuel
  orcidid: 0000-0003-2150-3160
  surname: Eichenlaub
  fullname: Eichenlaub, Manuel
  organization: Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany
– sequence: 2
  givenname: Stefan
  orcidid: 0000-0003-4629-7754
  surname: Pleus
  fullname: Pleus, Stefan
  organization: IFCC Scientific Division, Working Group on Continuous Glucose Monitoring
– sequence: 3
  givenname: Martina
  orcidid: 0000-0001-8009-4104
  surname: Rothenbühler
  fullname: Rothenbühler, Martina
  organization: Diabetes Center Berne, Bern, Switzerland
– sequence: 4
  givenname: Timothy S
  orcidid: 0000-0003-4178-3462
  surname: Bailey
  fullname: Bailey, Timothy S
  organization: AMCR Institute, Escondido, California, USA
– sequence: 5
  givenname: Lia
  orcidid: 0000-0003-1993-7672
  surname: Bally
  fullname: Bally, Lia
  organization: Department of Diabetes, Endocrinology, Nutritional Medicine and Metabolism, Inselspital Bern, Bern University Hospital and University of Bern, Bern, Switzerland
– sequence: 6
  givenname: Ronald
  surname: Brazg
  fullname: Brazg, Ronald
  organization: Rainier Clinical Research Center, Renton, Washington, USA
– sequence: 7
  givenname: Daniela
  orcidid: 0000-0002-2426-8955
  surname: Bruttomesso
  fullname: Bruttomesso, Daniela
  organization: Division of Metabolic Disease, Department of Medicine, University of Padua, Padua, Italy
– sequence: 8
  givenname: Peter
  surname: Diem
  fullname: Diem, Peter
  organization: Endokrinologie Diabetologie Bern, Bern, Switzerland
– sequence: 9
  givenname: Elisabet
  surname: Eriksson Boija
  fullname: Eriksson Boija, Elisabet
  organization: Equalis AB, Uppsala, Sweden
– sequence: 10
  givenname: Marion
  orcidid: 0000-0002-4687-1157
  surname: Fokkert
  fullname: Fokkert, Marion
  organization: Department of Clinical Chemistry, Isala Clinics, Zwolle, The Netherlands
– sequence: 11
  givenname: Cornelia
  surname: Haug
  fullname: Haug, Cornelia
  organization: Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany
– sequence: 12
  givenname: Rolf
  orcidid: 0000-0002-8419-4740
  surname: Hinzmann
  fullname: Hinzmann, Rolf
  organization: Roche Diabetes Care GmbH, Mannheim, Germany
– sequence: 13
  givenname: Johan
  orcidid: 0000-0003-1025-1682
  surname: Jendle
  fullname: Jendle, Johan
  organization: School of Medical Sciences, Faculty of Medicine and Health, Örebro University, Örebro, Sweden
– sequence: 14
  givenname: David C
  orcidid: 0000-0001-6394-6862
  surname: Klonoff
  fullname: Klonoff, David C
  organization: Diabetes Research Institute of Mills-Peninsula Medical Center, San Mateo, California, USA
– sequence: 15
  givenname: Julia K
  orcidid: 0000-0001-7854-4233
  surname: Mader
  fullname: Mader, Julia K
  organization: Division of Endocrinology and Diabetology, Medical University of Graz, Graz, Austria
– sequence: 16
  givenname: Konstantinos
  orcidid: 0000-0002-7896-9028
  surname: Makris
  fullname: Makris, Konstantinos
  organization: Clinical Biochemistry Department, KAT General Hospital, Athens, Greece
– sequence: 17
  givenname: Othmar
  orcidid: 0000-0002-1661-0685
  surname: Moser
  fullname: Moser, Othmar
  organization: Department of Exercise Physiology and Metabolism, University of Bayreuth, Bayreuth, Germany
– sequence: 18
  givenname: James H
  orcidid: 0000-0002-3652-1612
  surname: Nichols
  fullname: Nichols, James H
  organization: Department of Pathology, Microbiology and Immunology, Vanderbilt University Medical Center, Nashville, Tennessee, USA
– sequence: 19
  givenname: Kirsten
  orcidid: 0000-0003-1620-8271
  surname: Nørgaard
  fullname: Nørgaard, Kirsten
  organization: Department of Clinical Medicine, University of Copenhagen, Copenhagen, Denmark
– sequence: 20
  givenname: John
  orcidid: 0000-0002-0730-7879
  surname: Pemberton
  fullname: Pemberton, John
  organization: Birmingham Women's and Children's Foundation Trust, Birmingham, United Kingdom
– sequence: 21
  givenname: Elizabeth
  orcidid: 0000-0001-6923-7151
  surname: Selvin
  fullname: Selvin, Elizabeth
  organization: Department of Cardiovascular and Clinical Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, USA
– sequence: 22
  givenname: Loukia
  orcidid: 0000-0001-8993-2311
  surname: Spanou
  fullname: Spanou, Loukia
  organization: Department of Endocrinology, Diabetes and Metabolism, Hellenic Red Cross Hospital, Athens, Greece
– sequence: 23
  givenname: Andreas
  surname: Thomas
  fullname: Thomas, Andreas
  organization: Independent Scientific Consulting, Pirna, Germany
– sequence: 24
  givenname: Nam K
  orcidid: 0000-0003-1565-0025
  surname: Tran
  fullname: Tran, Nam K
  organization: Department of Pathology and Laboratory Medicine, University of California Davis Health, Sacramento, California, USA
– sequence: 25
  givenname: Lilian
  orcidid: 0000-0001-9459-875X
  surname: Witthauer
  fullname: Witthauer, Lilian
  organization: Department of Diabetes, Endocrinology, Nutritional Medicine and Metabolism, Inselspital Bern, Bern University Hospital and University of Bern, Bern, Switzerland
– sequence: 26
  givenname: Robbert J
  surname: Slingerland
  fullname: Slingerland, Robbert J
  organization: Department of Clinical Chemistry, Isala Clinics, Zwolle, The Netherlands
– sequence: 27
  givenname: Guido
  orcidid: 0000-0002-0406-9529
  surname: Freckmann
  fullname: Freckmann, Guido
  organization: IFCC Scientific Division, Working Group on Continuous Glucose Monitoring
BackLink https://www.ncbi.nlm.nih.gov/pubmed/38194227$$D View this record in MEDLINE/PubMed
BookMark eNo9kFtLxDAQhYMoXlYffZX8ga5J0yabR6lXUFxwfS5pMnEjbbIkqeAv8G_b4uVpzhzOnIHvBO374AGhc0qWlKzkpXFqWZKSLUnF6z10TOtaFKtasv1Zl6SQtOZH6CSld0KIYCU9REdsRWVVluIYfTVh2Kmocoj4WmWFm-206QzRpex0wsobvIFJ-ze8jkGDGSMkbKd83gJueuedVj1eQ5y8QXkN-OZD9aPKLngcLG6Cn67HMCZ81486JMBPwbvp49z58pkyDOkUHVjVJzj7nQv0enuzae6Lx-e7h-bqsdAVrXJhaEW7DjgrbVWBksoAJ8JayTU3VILkRhsriC5trcBKyWwnuZCScCqElmyBLn56d2M3gGl30Q0qfrZ_RKYA-wnMtvK-d9BBzP9BStqZeztxb2fu7cydfQNWy3mC
CitedBy_id crossref_primary_10_1177_19322968241267774
crossref_primary_10_1177_19322968241301800
crossref_primary_10_1177_19322968241232679
crossref_primary_10_1016_j_hlpt_2025_100991
crossref_primary_10_1089_dia_2024_0126
crossref_primary_10_1111_dom_16234
crossref_primary_10_1007_s00134_024_07663_6
crossref_primary_10_1515_cclm_2024_0675
crossref_primary_10_1007_s11428_024_01275_w
crossref_primary_10_1177_19322968251317526
crossref_primary_10_1177_19322968251315459
crossref_primary_10_1007_s13300_024_01654_y
crossref_primary_10_1055_a_2312_1073
crossref_primary_10_1136_bmjdrc_2024_004369
crossref_primary_10_1159_000543156
crossref_primary_10_1111_dom_16153
crossref_primary_10_1177_19322968241227976
crossref_primary_10_1177_19322968241296097
ContentType Journal Article
Copyright Manuel Eichenlaub, et al., 2024; Published by Mary Ann Liebert, Inc.
Copyright_xml – notice: Manuel Eichenlaub, et al., 2024; Published by Mary Ann Liebert, Inc.
DBID 1-M
NPM
DOI 10.1089/dia.2023.0465
DatabaseName Mary Ann Liebert Online - Open Access
PubMed
DatabaseTitle PubMed
DatabaseTitleList
PubMed
Database_xml – sequence: 1
  dbid: NPM
  name: PubMed
  url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 2
  dbid: 1-M
  name: Mary Ann Liebert Online - Open Access
  url: http://liebertopenaccess.com/OAJournals
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Medicine
EISSN 1557-8593
ExternalDocumentID 38194227
10_1089_dia_2023_0465
Genre Journal Article
Review
GroupedDBID ---
0R~
1-M
29F
4.4
53G
6PF
AAWTL
ABBKN
ABJNI
ACGFS
ADBBV
AENEX
AHMBA
ALMA_UNASSIGNED_HOLDINGS
BNQNF
CS3
DU5
EBS
F5P
IHR
IM4
INH
MV1
NQHIM
O9-
PQQKQ
RIG
RML
UE5
NPM
ID FETCH-LOGICAL-c414t-d141bbe632f44ea9ade607ff96c6d19e96dcdf70c2f5aef993fb9679906177c93
IEDL.DBID 1-M
ISSN 1520-9156
IngestDate Wed Feb 19 02:11:07 EST 2025
Tue Oct 01 17:28:33 EDT 2024
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Keywords Continuous glucose monitoring
Comparator data characteristics
Testing procedures
Clinical performance evaluation
Glucose rate of change
Standardization
Language English
License This Open Access article is distributed under the terms of the Creative Commons License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c414t-d141bbe632f44ea9ade607ff96c6d19e96dcdf70c2f5aef993fb9679906177c93
ORCID 0000-0002-1661-0685
0000-0002-8419-4740
0000-0001-6923-7151
0000-0003-4629-7754
0000-0001-8009-4104
0000-0003-4178-3462
0000-0002-0730-7879
0000-0001-8993-2311
0000-0003-1025-1682
0000-0001-6394-6862
0000-0002-3652-1612
0000-0003-1620-8271
0000-0001-9459-875X
0000-0003-1993-7672
0000-0002-2426-8955
0000-0003-2150-3160
0000-0001-7854-4233
0000-0002-7896-9028
0000-0002-4687-1157
0000-0002-0406-9529
0000-0003-1565-0025
OpenAccessLink https://www.liebertpub.com/doi/abs/10.1089/dia.2023.0465
PMID 38194227
ParticipantIDs pubmed_primary_38194227
maryannliebert_primary_10_1089_dia_2023_0465
PublicationCentury 2000
PublicationDate 2024-04-01
PublicationDateYYYYMMDD 2024-04-01
PublicationDate_xml – month: 04
  year: 2024
  text: 2024-04-01
  day: 01
PublicationDecade 2020
PublicationPlace United States
PublicationPlace_xml – name: United States
PublicationTitle Diabetes technology & therapeutics
PublicationTitleAlternate Diabetes Technol Ther
PublicationYear 2024
Publisher Mary Ann Liebert, Inc., publishers
Publisher_xml – name: Mary Ann Liebert, Inc., publishers
SSID ssj0007321
Score 2.5075538
SecondaryResourceType review_article
Snippet Comparing the performance of different continuous glucose monitoring (CGM) systems is challenging due to the lack of comprehensive guidelines for clinical...
SourceID pubmed
maryannliebert
SourceType Index Database
Publisher
SubjectTerms Review
Title Comparator Data Characteristics and Testing Procedures for the Clinical Performance Evaluation of Continuous Glucose Monitoring Systems
URI https://www.liebertpub.com/doi/abs/10.1089/dia.2023.0465
https://www.ncbi.nlm.nih.gov/pubmed/38194227
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3JTsMwELVKkRBIIHbKpjlwJCWL48RHVFoqpFQ9tFJvkR3bCAklqMs38NuME1NUOHGJcsimGS_vxW-eCbmjkRDKaOFJJSKPMsM9wajViIVUCkF9I2xxcjZiwyl9mcWzFkm_a2EaXbO2omL8nnqotn1byIUTxPEHjFvXbvrdRWoXb5HtEEGLbc-Bl63H4CRqKq5iJEccKYpz1_xz-x7ZtxVioizdS3-hy3qWGRySAwcP4bHJ5xFp6fKY7GRuAfyEfPacW3c1hyexFNDbNFwGUSqYWOeM8hXqIgC1QkINCE0BoR44G9B3GP8UDEB_7fgNlQHrV_VWrqrVAp4bPTs0Hd_-AQTncH5KpoP-pDf03F4KXkEDuvRUQAMpNYtCQ6kWXCjN_MQYzgqmAq45U4UyiV-EJhbaIGoxkrME5yqEOEnBozPSLqtSXxBQLKVSmoSZKKFSx6mPHE5zmVKO7JD6HXK_GdP8ozHOyOsF75TnmILcpiC3KeiQ8ybi68ssiaRhmFz-70FXZBfPnazmmrSX85W-QcSwlLd148DjaJx9AXUIwZo
linkProvider Mary Ann Liebert, Inc.
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3JTsMwFLSgSCwSiJ2yvgNHUrI4TnxEpaVAW3Fopd4iO7YREnJQSb6B38ZOrLKduEbZ5Odlxp43D6FLHDEmlGQeFyzyMFHUYwRbjViIOWPYV8wmJ4_GZDDFD7N49q3UV6NrllZUbP6nnqrt2LZ70U4RR69Nw3Vs1e-O4XbxMlqxllzWNj_wRotJOImalKvYsCNqOIqz1_zz-AbatCliTGv31V_wsl5m-ttoy-FDuGkCuoOWpN5FqyN3Ar6HPrrOrruYwy0rGXR_Oi4D0wIm1jpDP0OdBSAqw6jBYFMwWA-cD-grPH1lDEBvYfkNhQJrWPWiq6J6h7tG0A7NyLdbgOAszvfRtN-bdAeeK6bg5TjApScCHHAuSRQqjCWjTEjiJ0pRkhMRUEmJyIVK_DxUMZPKwBbFKUnMYmUwTpLT6AC1dKHlEQJBUsy5SoiKEsxlnPqGxEnKU0wNPcR-G139bNPsrXHOyOoT75RmJgSZDUFmQ9BGh02LL26zLBKHYXL8vxddoLXBZDTMhvfjxxO0bq47jc0papXzSp4Z-FDy87qjfAJa1cP4
linkToPdf http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3JTsMwELWgSBVIIHbKOgeOpGRxnPiISktZWvXQSr1FdmwjJJRWpf0GfptxYhUKJ65R4kQzXt6L3zwTck0jIZTRwpNKRB5lhnuCUasRC6kUgvpG2OLkXp91R_RpHI9_HPVV6Zq1FRXj95RTtR3beqqMU8TxWwxc05763URuF6-TDQTZqe3cgddbTsJJVJVcxciOOHIUZ6_55_Etsm1LxERRuLf-gpflMtPZJTsOH8JdldA9sqaLfVLvuR3wA_LZcnbdkxnci7mA1qrjMohCwdBaZxSvUFYBqAUyakBsCoj1wPmAvsPgu2IA2kvLb5gYsIZVb8VisviAh0rQDtXIt78AwVmcH5JRpz1sdT13mIKX04DOPRXQQErNotBQqgUXSjM_MYaznKmAa85Urkzi56GJhTYIW4zkLMHFCjFOkvPoiNSKSaFPCCiWUilNwkyUUKnj1EcSp7lMKUd6SP0GuVmNaTatnDOycsc75RmmILMpyGwKGuS4ivjyNssiaRgmp_9r6IrUB_ed7OWx_3xGNvGyk9ick9p8ttAXiB7m8rLsJ19plMOL
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Comparator+Data+Characteristics+and+Testing+Procedures+for+the+Clinical+Performance+Evaluation+of+Continuous+Glucose+Monitoring+Systems&rft.jtitle=Diabetes+technology+%26+therapeutics&rft.date=2024-04-01&rft.pub=Mary+Ann+Liebert%2C+Inc.%2C+publishers&rft.issn=1520-9156&rft.eissn=1557-8593&rft_id=info:doi/10.1089%2Fdia.2023.0465&rft.externalDocID=10_1089_dia_2023_0465
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1520-9156&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1520-9156&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1520-9156&client=summon