Comparator Data Characteristics and Testing Procedures for the Clinical Performance Evaluation of Continuous Glucose Monitoring Systems
Comparing the performance of different continuous glucose monitoring (CGM) systems is challenging due to the lack of comprehensive guidelines for clinical study design. In particular, the absence of concise requirements for the distribution of comparator (reference) blood glucose (BG) concentrations...
Saved in:
Published in | Diabetes technology & therapeutics |
---|---|
Main Authors | , , , , , , , , , , , , , , , , , , , , , , , , , , |
Format | Journal Article |
Language | English |
Published |
United States
Mary Ann Liebert, Inc., publishers
01.04.2024
|
Subjects | |
Online Access | Get full text |
ISSN | 1520-9156 1557-8593 |
DOI | 10.1089/dia.2023.0465 |
Cover
Abstract | Comparing the performance of different continuous glucose monitoring (CGM) systems is challenging due to the lack of comprehensive guidelines for clinical study design. In particular, the absence of concise requirements for the distribution of comparator (reference) blood glucose (BG) concentrations and their rate of change (RoC) that are used to evaluate CGM performance, impairs comparability. For this article, several experts in the field of CGM performance testing have collaborated to propose characteristics of the distribution of comparator measurements that should be collected during CGM performance testing. Specifically, it is proposed that at least 7.5% of comparator BG concentrations are <70 mg/dL (3.9 mmol/L) and >300 mg/dL (16.7 mmol/L), respectively, and that at least 7.5% of BG-RoC combinations indicate fast BG changes with impending hypo- or hyperglycemia, respectively. These proposed characteristics of the comparator data can facilitate the harmonization of testing conditions across different studies and CGM systems and ensure that the most relevant scenarios representing real-life situations are established during performance testing. In addition, a study protocol and testing procedure for the manipulation of glucose levels are suggested that enable the collection of comparator data with these characteristics. This work is an important step toward establishing a future standard for the performance evaluation of CGM systems. |
---|---|
AbstractList | Comparing the performance of different continuous glucose monitoring (CGM) systems is challenging due to the lack of comprehensive guidelines for clinical study design. In particular, the absence of concise requirements for the distribution of comparator (reference) blood glucose (BG) concentrations and their rate of change (RoC) that are used to evaluate CGM performance, impairs comparability. For this article, several experts in the field of CGM performance testing have collaborated to propose characteristics of the distribution of comparator measurements that should be collected during CGM performance testing. Specifically, it is proposed that at least 7.5% of comparator BG concentrations are <70 mg/dL (3.9 mmol/L) and >300 mg/dL (16.7 mmol/L), respectively, and that at least 7.5% of BG-RoC combinations indicate fast BG changes with impending hypo- or hyperglycemia, respectively. These proposed characteristics of the comparator data can facilitate the harmonization of testing conditions across different studies and CGM systems and ensure that the most relevant scenarios representing real-life situations are established during performance testing. In addition, a study protocol and testing procedure for the manipulation of glucose levels are suggested that enable the collection of comparator data with these characteristics. This work is an important step toward establishing a future standard for the performance evaluation of CGM systems. |
Author | Slingerland, Robbert J Bally, Lia Jendle, Johan Diem, Peter Eriksson Boija, Elisabet Bruttomesso, Daniela Brazg, Ronald Tran, Nam K Haug, Cornelia Hinzmann, Rolf Mader, Julia K Rothenbühler, Martina Pemberton, John Selvin, Elizabeth Klonoff, David C Bailey, Timothy S Makris, Konstantinos Witthauer, Lilian Freckmann, Guido Moser, Othmar Eichenlaub, Manuel Pleus, Stefan Fokkert, Marion Nichols, James H Spanou, Loukia Nørgaard, Kirsten Thomas, Andreas |
Author_xml | – sequence: 1 givenname: Manuel orcidid: 0000-0003-2150-3160 surname: Eichenlaub fullname: Eichenlaub, Manuel organization: Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany – sequence: 2 givenname: Stefan orcidid: 0000-0003-4629-7754 surname: Pleus fullname: Pleus, Stefan organization: IFCC Scientific Division, Working Group on Continuous Glucose Monitoring – sequence: 3 givenname: Martina orcidid: 0000-0001-8009-4104 surname: Rothenbühler fullname: Rothenbühler, Martina organization: Diabetes Center Berne, Bern, Switzerland – sequence: 4 givenname: Timothy S orcidid: 0000-0003-4178-3462 surname: Bailey fullname: Bailey, Timothy S organization: AMCR Institute, Escondido, California, USA – sequence: 5 givenname: Lia orcidid: 0000-0003-1993-7672 surname: Bally fullname: Bally, Lia organization: Department of Diabetes, Endocrinology, Nutritional Medicine and Metabolism, Inselspital Bern, Bern University Hospital and University of Bern, Bern, Switzerland – sequence: 6 givenname: Ronald surname: Brazg fullname: Brazg, Ronald organization: Rainier Clinical Research Center, Renton, Washington, USA – sequence: 7 givenname: Daniela orcidid: 0000-0002-2426-8955 surname: Bruttomesso fullname: Bruttomesso, Daniela organization: Division of Metabolic Disease, Department of Medicine, University of Padua, Padua, Italy – sequence: 8 givenname: Peter surname: Diem fullname: Diem, Peter organization: Endokrinologie Diabetologie Bern, Bern, Switzerland – sequence: 9 givenname: Elisabet surname: Eriksson Boija fullname: Eriksson Boija, Elisabet organization: Equalis AB, Uppsala, Sweden – sequence: 10 givenname: Marion orcidid: 0000-0002-4687-1157 surname: Fokkert fullname: Fokkert, Marion organization: Department of Clinical Chemistry, Isala Clinics, Zwolle, The Netherlands – sequence: 11 givenname: Cornelia surname: Haug fullname: Haug, Cornelia organization: Institut für Diabetes-Technologie, Forschungs- und Entwicklungsgesellschaft mbH an der Universität Ulm, Ulm, Germany – sequence: 12 givenname: Rolf orcidid: 0000-0002-8419-4740 surname: Hinzmann fullname: Hinzmann, Rolf organization: Roche Diabetes Care GmbH, Mannheim, Germany – sequence: 13 givenname: Johan orcidid: 0000-0003-1025-1682 surname: Jendle fullname: Jendle, Johan organization: School of Medical Sciences, Faculty of Medicine and Health, Örebro University, Örebro, Sweden – sequence: 14 givenname: David C orcidid: 0000-0001-6394-6862 surname: Klonoff fullname: Klonoff, David C organization: Diabetes Research Institute of Mills-Peninsula Medical Center, San Mateo, California, USA – sequence: 15 givenname: Julia K orcidid: 0000-0001-7854-4233 surname: Mader fullname: Mader, Julia K organization: Division of Endocrinology and Diabetology, Medical University of Graz, Graz, Austria – sequence: 16 givenname: Konstantinos orcidid: 0000-0002-7896-9028 surname: Makris fullname: Makris, Konstantinos organization: Clinical Biochemistry Department, KAT General Hospital, Athens, Greece – sequence: 17 givenname: Othmar orcidid: 0000-0002-1661-0685 surname: Moser fullname: Moser, Othmar organization: Department of Exercise Physiology and Metabolism, University of Bayreuth, Bayreuth, Germany – sequence: 18 givenname: James H orcidid: 0000-0002-3652-1612 surname: Nichols fullname: Nichols, James H organization: Department of Pathology, Microbiology and Immunology, Vanderbilt University Medical Center, Nashville, Tennessee, USA – sequence: 19 givenname: Kirsten orcidid: 0000-0003-1620-8271 surname: Nørgaard fullname: Nørgaard, Kirsten organization: Department of Clinical Medicine, University of Copenhagen, Copenhagen, Denmark – sequence: 20 givenname: John orcidid: 0000-0002-0730-7879 surname: Pemberton fullname: Pemberton, John organization: Birmingham Women's and Children's Foundation Trust, Birmingham, United Kingdom – sequence: 21 givenname: Elizabeth orcidid: 0000-0001-6923-7151 surname: Selvin fullname: Selvin, Elizabeth organization: Department of Cardiovascular and Clinical Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, USA – sequence: 22 givenname: Loukia orcidid: 0000-0001-8993-2311 surname: Spanou fullname: Spanou, Loukia organization: Department of Endocrinology, Diabetes and Metabolism, Hellenic Red Cross Hospital, Athens, Greece – sequence: 23 givenname: Andreas surname: Thomas fullname: Thomas, Andreas organization: Independent Scientific Consulting, Pirna, Germany – sequence: 24 givenname: Nam K orcidid: 0000-0003-1565-0025 surname: Tran fullname: Tran, Nam K organization: Department of Pathology and Laboratory Medicine, University of California Davis Health, Sacramento, California, USA – sequence: 25 givenname: Lilian orcidid: 0000-0001-9459-875X surname: Witthauer fullname: Witthauer, Lilian organization: Department of Diabetes, Endocrinology, Nutritional Medicine and Metabolism, Inselspital Bern, Bern University Hospital and University of Bern, Bern, Switzerland – sequence: 26 givenname: Robbert J surname: Slingerland fullname: Slingerland, Robbert J organization: Department of Clinical Chemistry, Isala Clinics, Zwolle, The Netherlands – sequence: 27 givenname: Guido orcidid: 0000-0002-0406-9529 surname: Freckmann fullname: Freckmann, Guido organization: IFCC Scientific Division, Working Group on Continuous Glucose Monitoring |
BackLink | https://www.ncbi.nlm.nih.gov/pubmed/38194227$$D View this record in MEDLINE/PubMed |
BookMark | eNo9kFtLxDAQhYMoXlYffZX8ga5J0yabR6lXUFxwfS5pMnEjbbIkqeAv8G_b4uVpzhzOnIHvBO374AGhc0qWlKzkpXFqWZKSLUnF6z10TOtaFKtasv1Zl6SQtOZH6CSld0KIYCU9REdsRWVVluIYfTVh2Kmocoj4WmWFm-206QzRpex0wsobvIFJ-ze8jkGDGSMkbKd83gJueuedVj1eQ5y8QXkN-OZD9aPKLngcLG6Cn67HMCZ81486JMBPwbvp49z58pkyDOkUHVjVJzj7nQv0enuzae6Lx-e7h-bqsdAVrXJhaEW7DjgrbVWBksoAJ8JayTU3VILkRhsriC5trcBKyWwnuZCScCqElmyBLn56d2M3gGl30Q0qfrZ_RKYA-wnMtvK-d9BBzP9BStqZeztxb2fu7cydfQNWy3mC |
CitedBy_id | crossref_primary_10_1177_19322968241267774 crossref_primary_10_1177_19322968241301800 crossref_primary_10_1177_19322968241232679 crossref_primary_10_1016_j_hlpt_2025_100991 crossref_primary_10_1089_dia_2024_0126 crossref_primary_10_1111_dom_16234 crossref_primary_10_1007_s00134_024_07663_6 crossref_primary_10_1515_cclm_2024_0675 crossref_primary_10_1007_s11428_024_01275_w crossref_primary_10_1177_19322968251317526 crossref_primary_10_1177_19322968251315459 crossref_primary_10_1007_s13300_024_01654_y crossref_primary_10_1055_a_2312_1073 crossref_primary_10_1136_bmjdrc_2024_004369 crossref_primary_10_1159_000543156 crossref_primary_10_1111_dom_16153 crossref_primary_10_1177_19322968241227976 crossref_primary_10_1177_19322968241296097 |
ContentType | Journal Article |
Copyright | Manuel Eichenlaub, et al., 2024; Published by Mary Ann Liebert, Inc. |
Copyright_xml | – notice: Manuel Eichenlaub, et al., 2024; Published by Mary Ann Liebert, Inc. |
DBID | 1-M NPM |
DOI | 10.1089/dia.2023.0465 |
DatabaseName | Mary Ann Liebert Online - Open Access PubMed |
DatabaseTitle | PubMed |
DatabaseTitleList | PubMed |
Database_xml | – sequence: 1 dbid: NPM name: PubMed url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 2 dbid: 1-M name: Mary Ann Liebert Online - Open Access url: http://liebertopenaccess.com/OAJournals sourceTypes: Publisher |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Medicine |
EISSN | 1557-8593 |
ExternalDocumentID | 38194227 10_1089_dia_2023_0465 |
Genre | Journal Article Review |
GroupedDBID | --- 0R~ 1-M 29F 4.4 53G 6PF AAWTL ABBKN ABJNI ACGFS ADBBV AENEX AHMBA ALMA_UNASSIGNED_HOLDINGS BNQNF CS3 DU5 EBS F5P IHR IM4 INH MV1 NQHIM O9- PQQKQ RIG RML UE5 NPM |
ID | FETCH-LOGICAL-c414t-d141bbe632f44ea9ade607ff96c6d19e96dcdf70c2f5aef993fb9679906177c93 |
IEDL.DBID | 1-M |
ISSN | 1520-9156 |
IngestDate | Wed Feb 19 02:11:07 EST 2025 Tue Oct 01 17:28:33 EDT 2024 |
IsDoiOpenAccess | true |
IsOpenAccess | true |
IsPeerReviewed | true |
IsScholarly | true |
Keywords | Continuous glucose monitoring Comparator data characteristics Testing procedures Clinical performance evaluation Glucose rate of change Standardization |
Language | English |
License | This Open Access article is distributed under the terms of the Creative Commons License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-c414t-d141bbe632f44ea9ade607ff96c6d19e96dcdf70c2f5aef993fb9679906177c93 |
ORCID | 0000-0002-1661-0685 0000-0002-8419-4740 0000-0001-6923-7151 0000-0003-4629-7754 0000-0001-8009-4104 0000-0003-4178-3462 0000-0002-0730-7879 0000-0001-8993-2311 0000-0003-1025-1682 0000-0001-6394-6862 0000-0002-3652-1612 0000-0003-1620-8271 0000-0001-9459-875X 0000-0003-1993-7672 0000-0002-2426-8955 0000-0003-2150-3160 0000-0001-7854-4233 0000-0002-7896-9028 0000-0002-4687-1157 0000-0002-0406-9529 0000-0003-1565-0025 |
OpenAccessLink | https://www.liebertpub.com/doi/abs/10.1089/dia.2023.0465 |
PMID | 38194227 |
ParticipantIDs | pubmed_primary_38194227 maryannliebert_primary_10_1089_dia_2023_0465 |
PublicationCentury | 2000 |
PublicationDate | 2024-04-01 |
PublicationDateYYYYMMDD | 2024-04-01 |
PublicationDate_xml | – month: 04 year: 2024 text: 2024-04-01 day: 01 |
PublicationDecade | 2020 |
PublicationPlace | United States |
PublicationPlace_xml | – name: United States |
PublicationTitle | Diabetes technology & therapeutics |
PublicationTitleAlternate | Diabetes Technol Ther |
PublicationYear | 2024 |
Publisher | Mary Ann Liebert, Inc., publishers |
Publisher_xml | – name: Mary Ann Liebert, Inc., publishers |
SSID | ssj0007321 |
Score | 2.5075538 |
SecondaryResourceType | review_article |
Snippet | Comparing the performance of different continuous glucose monitoring (CGM) systems is challenging due to the lack of comprehensive guidelines for clinical... |
SourceID | pubmed maryannliebert |
SourceType | Index Database Publisher |
SubjectTerms | Review |
Title | Comparator Data Characteristics and Testing Procedures for the Clinical Performance Evaluation of Continuous Glucose Monitoring Systems |
URI | https://www.liebertpub.com/doi/abs/10.1089/dia.2023.0465 https://www.ncbi.nlm.nih.gov/pubmed/38194227 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3JTsMwELVKkRBIIHbKpjlwJCWL48RHVFoqpFQ9tFJvkR3bCAklqMs38NuME1NUOHGJcsimGS_vxW-eCbmjkRDKaOFJJSKPMsM9wajViIVUCkF9I2xxcjZiwyl9mcWzFkm_a2EaXbO2omL8nnqotn1byIUTxPEHjFvXbvrdRWoXb5HtEEGLbc-Bl63H4CRqKq5iJEccKYpz1_xz-x7ZtxVioizdS3-hy3qWGRySAwcP4bHJ5xFp6fKY7GRuAfyEfPacW3c1hyexFNDbNFwGUSqYWOeM8hXqIgC1QkINCE0BoR44G9B3GP8UDEB_7fgNlQHrV_VWrqrVAp4bPTs0Hd_-AQTncH5KpoP-pDf03F4KXkEDuvRUQAMpNYtCQ6kWXCjN_MQYzgqmAq45U4UyiV-EJhbaIGoxkrME5yqEOEnBozPSLqtSXxBQLKVSmoSZKKFSx6mPHE5zmVKO7JD6HXK_GdP8ozHOyOsF75TnmILcpiC3KeiQ8ybi68ssiaRhmFz-70FXZBfPnazmmrSX85W-QcSwlLd148DjaJx9AXUIwZo |
linkProvider | Mary Ann Liebert, Inc. |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3JTsMwFLSgSCwSiJ2yvgNHUrI4TnxEpaVAW3Fopd4iO7YREnJQSb6B38ZOrLKduEbZ5Odlxp43D6FLHDEmlGQeFyzyMFHUYwRbjViIOWPYV8wmJ4_GZDDFD7N49q3UV6NrllZUbP6nnqrt2LZ70U4RR69Nw3Vs1e-O4XbxMlqxllzWNj_wRotJOImalKvYsCNqOIqz1_zz-AbatCliTGv31V_wsl5m-ttoy-FDuGkCuoOWpN5FqyN3Ar6HPrrOrruYwy0rGXR_Oi4D0wIm1jpDP0OdBSAqw6jBYFMwWA-cD-grPH1lDEBvYfkNhQJrWPWiq6J6h7tG0A7NyLdbgOAszvfRtN-bdAeeK6bg5TjApScCHHAuSRQqjCWjTEjiJ0pRkhMRUEmJyIVK_DxUMZPKwBbFKUnMYmUwTpLT6AC1dKHlEQJBUsy5SoiKEsxlnPqGxEnKU0wNPcR-G139bNPsrXHOyOoT75RmJgSZDUFmQ9BGh02LL26zLBKHYXL8vxddoLXBZDTMhvfjxxO0bq47jc0papXzSp4Z-FDy87qjfAJa1cP4 |
linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3JTsMwELWgSBVIIHbKOgeOpGRxnPiISktZWvXQSr1FdmwjJJRWpf0GfptxYhUKJ65R4kQzXt6L3zwTck0jIZTRwpNKRB5lhnuCUasRC6kUgvpG2OLkXp91R_RpHI9_HPVV6Zq1FRXj95RTtR3beqqMU8TxWwxc05763URuF6-TDQTZqe3cgddbTsJJVJVcxciOOHIUZ6_55_Etsm1LxERRuLf-gpflMtPZJTsOH8JdldA9sqaLfVLvuR3wA_LZcnbdkxnci7mA1qrjMohCwdBaZxSvUFYBqAUyakBsCoj1wPmAvsPgu2IA2kvLb5gYsIZVb8VisviAh0rQDtXIt78AwVmcH5JRpz1sdT13mIKX04DOPRXQQErNotBQqgUXSjM_MYaznKmAa85Urkzi56GJhTYIW4zkLMHFCjFOkvPoiNSKSaFPCCiWUilNwkyUUKnj1EcSp7lMKUd6SP0GuVmNaTatnDOycsc75RmmILMpyGwKGuS4ivjyNssiaRgmp_9r6IrUB_ed7OWx_3xGNvGyk9ick9p8ttAXiB7m8rLsJ19plMOL |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Comparator+Data+Characteristics+and+Testing+Procedures+for+the+Clinical+Performance+Evaluation+of+Continuous+Glucose+Monitoring+Systems&rft.jtitle=Diabetes+technology+%26+therapeutics&rft.date=2024-04-01&rft.pub=Mary+Ann+Liebert%2C+Inc.%2C+publishers&rft.issn=1520-9156&rft.eissn=1557-8593&rft_id=info:doi/10.1089%2Fdia.2023.0465&rft.externalDocID=10_1089_dia_2023_0465 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1520-9156&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1520-9156&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1520-9156&client=summon |