Bootstrap-based testing approaches for the assessment of the diagnostic accuracy of biomarkers subject to a limit of detection

Assessment of the diagnostic accuracy of biomarkers through receiver operating characteristic curve analysis frequently involves a limit of detection imposed by the laboratory analytical system precision. As a consequence, measurements below a certain level are undetectable and ignoring these is kno...

Full description

Saved in:
Bibliographic Details
Published inStatistical methods in medical research Vol. 28; no. 5; p. 1564
Main Authors Franco-Pereira, Alba M, Nakas, Christos T, Leichtle, Alexander B, Pardo, M Carmen
Format Journal Article
LanguageEnglish
Published England 01.05.2019
Subjects
Online AccessGet more information
ISSN1477-0334
DOI10.1177/0962280218769334

Cover

Loading…
Abstract Assessment of the diagnostic accuracy of biomarkers through receiver operating characteristic curve analysis frequently involves a limit of detection imposed by the laboratory analytical system precision. As a consequence, measurements below a certain level are undetectable and ignoring these is known to lead to negatively biased estimates of the area under the receiver operating characteristic curve. In this article, we introduce two receiver operating characteristic curve-based parametric approaches that tackle the issue of correct assessment of diagnostic markers in the presence of a limit of detection. Proposed approaches are simulation-based utilising bootstrap methodology. Non-parametric alternatives that are naively used in the literature do not solve the inherent problem of limit of detection values which are treated as censored observations. However, the latter seems to perform adequately well in our simulation study. Nonparametric bootstrap was consistently used throughout, while other bootstrap alternatives performed similarly in our pilot simulation study. The simulation study involves the comparison of parametric and non-parametric options described here versus alternative strategies that are routinely used in the literature. We apply all methods to a study-setting resembling a chemical quasi-standard situation, where compound tumour biomarkers were searched within a multi-variable set of measurements to discriminate between two groups, namely colorectal cancer and controls. We focus in the assessment of glutamine and methionine.
AbstractList Assessment of the diagnostic accuracy of biomarkers through receiver operating characteristic curve analysis frequently involves a limit of detection imposed by the laboratory analytical system precision. As a consequence, measurements below a certain level are undetectable and ignoring these is known to lead to negatively biased estimates of the area under the receiver operating characteristic curve. In this article, we introduce two receiver operating characteristic curve-based parametric approaches that tackle the issue of correct assessment of diagnostic markers in the presence of a limit of detection. Proposed approaches are simulation-based utilising bootstrap methodology. Non-parametric alternatives that are naively used in the literature do not solve the inherent problem of limit of detection values which are treated as censored observations. However, the latter seems to perform adequately well in our simulation study. Nonparametric bootstrap was consistently used throughout, while other bootstrap alternatives performed similarly in our pilot simulation study. The simulation study involves the comparison of parametric and non-parametric options described here versus alternative strategies that are routinely used in the literature. We apply all methods to a study-setting resembling a chemical quasi-standard situation, where compound tumour biomarkers were searched within a multi-variable set of measurements to discriminate between two groups, namely colorectal cancer and controls. We focus in the assessment of glutamine and methionine.
Author Franco-Pereira, Alba M
Pardo, M Carmen
Nakas, Christos T
Leichtle, Alexander B
Author_xml – sequence: 1
  givenname: Alba M
  orcidid: 0000-0002-7480-1770
  surname: Franco-Pereira
  fullname: Franco-Pereira, Alba M
  organization: 1 Department of Statistics and OR, Complutense University of Madrid, Madrid, Spain
– sequence: 2
  givenname: Christos T
  surname: Nakas
  fullname: Nakas, Christos T
  organization: 3 University Institute of Clinical Chemistry, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
– sequence: 3
  givenname: Alexander B
  surname: Leichtle
  fullname: Leichtle, Alexander B
  organization: 3 University Institute of Clinical Chemistry, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
– sequence: 4
  givenname: M Carmen
  surname: Pardo
  fullname: Pardo, M Carmen
  organization: 1 Department of Statistics and OR, Complutense University of Madrid, Madrid, Spain
BackLink https://www.ncbi.nlm.nih.gov/pubmed/29635975$$D View this record in MEDLINE/PubMed
BookMark eNo1kEtPwzAQhC0Eog-4c0L-AwE_Ejs-QkUBqRIXOFcbe9O6NHFku4de-O2EAqddfbMzGu2MnPehR0JuOLvjXOt7ZpQQNRO81spIWZ6RKS-1Lti4T8gspR1jTLPSXJKJMEpWRldT8vUYQk45wlA0kNDRjCn7fkNhGGIAu8VE2xBp3iKFlDClDvtMQ3sizsOmD6PBUrD2EMEef6TGhw7iJ8ZE06HZoc00Bwp07zt_8jrMI_ShvyIXLewTXv_NOflYPr0vXorV2_Pr4mFVWKmqXNS8KtECli1wh6VqLIoWLFdSuFqCYRKYrBRrrLEtaoHG1A7K8ap2jeMg5uT2N3c4NB269RD92PC4_n-E-AY4MGPJ
CitedBy_id crossref_primary_10_1371_journal_pone_0293640
ContentType Journal Article
DBID NPM
DOI 10.1177/0962280218769334
DatabaseName PubMed
DatabaseTitle PubMed
DatabaseTitleList PubMed
Database_xml – sequence: 1
  dbid: NPM
  name: PubMed
  url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
DeliveryMethod no_fulltext_linktorsrc
Discipline Medicine
Statistics
Mathematics
EISSN 1477-0334
ExternalDocumentID 29635975
Genre Research Support, Non-U.S. Gov't
Journal Article
GroupedDBID ---
-TM
.2G
.2J
.2N
0-V
01A
0R~
123
1~K
29Q
31S
31U
31X
31Y
31Z
36B
3V.
4.4
53G
54M
5RE
5VS
6PF
7X7
88E
88I
8C1
8FE
8FG
8FI
8FJ
8R4
8R5
AABMB
AABOD
AACKU
AACMV
AACTG
AADTT
AADUE
AAEWN
AAGGD
AAJIQ
AAJOX
AAJPV
AAMGE
AANSI
AAPEO
AAQDB
AAQXH
AAQXI
AARDL
AARIX
AATAA
AATBZ
AAWTL
AAYTG
ABAWP
ABCCA
ABCJG
ABDLQ
ABDWY
ABEIX
ABFWQ
ABHKI
ABHQH
ABJCF
ABJIS
ABKRH
ABLUO
ABPGX
ABPNF
ABQKF
ABQXT
ABRHV
ABTDE
ABUJY
ABUWG
ABVFX
ABVVC
ABYTW
ACARO
ACDSZ
ACDXX
ACFEJ
ACFMA
ACGBL
ACGFS
ACGOD
ACGZU
ACIWK
ACJER
ACLHI
ACLZU
ACOFE
ACOXC
ACROE
ACRPL
ACSBE
ACSIQ
ACTQU
ACUAV
ACUIR
ACXKE
ACXMB
ADBBV
ADEIA
ADNMO
ADNON
ADRRZ
ADTBJ
ADUKL
ADVBO
ADYCS
AECGH
AECVZ
AEDTQ
AENEX
AEPTA
AEQLS
AERKM
AESZF
AEUHG
AEUIJ
AEWDL
AEWHI
AEXNY
AFEET
AFKBI
AFKRA
AFKRG
AFMOU
AFQAA
AFUIA
AFWMB
AGKLV
AGNHF
AGWFA
AGWNL
AHDMH
AHHFK
AHMBA
AIOMO
AJEFB
AJMMQ
AJUZI
AJXAJ
ALIPV
ALKWR
ALMA_UNASSIGNED_HOLDINGS
ALSLI
AMCVQ
ANDLU
ARALO
ARTOV
ASOEW
ASPBG
AUTPY
AUVAJ
AVWKF
AYAKG
AZFZN
AZQEC
B8O
B8R
B8Z
B93
B94
BBRGL
BDDNI
BENPR
BGLVJ
BKIIM
BPACV
BPHCQ
BSEHC
BVXVI
BYIEH
C45
CAG
CBRKF
CCPQU
CFDXU
COF
CORYS
CQQTX
CS3
DC-
DD-
DD0
DE-
DF0
DO-
DOPDO
DU5
DV7
DWQXO
D~Y
EAD
EAP
EBS
EJD
EMB
EMK
EMOBN
ESX
F5P
FEDTE
FHBDP
FYUFA
GNUQQ
GROUPED_SAGE_PREMIER_JOURNAL_COLLECTION
H13
HCIFZ
HEHIP
HF~
HMCUK
HVGLF
HZ~
J8X
K.F
K.J
L6V
M1P
M2P
M2S
M4V
M7S
N9A
NPM
O9-
OVD
P.B
P2P
PQQKQ
PROAC
PSQYO
PTHSS
Q1R
Q2X
Q7K
Q7L
Q7X
Q82
Q83
RIG
ROL
S01
SAUOL
SCNPE
SDB
SFB
SFC
SFK
SFN
SFT
SGA
SGP
SGR
SGV
SGX
SGZ
SHG
SNB
SPJ
SPV
SQCSI
STM
SV3
TEORI
TN5
UKHRP
YHZ
ZONMY
ZPPRI
ZRKOI
ID FETCH-LOGICAL-c365t-8154ecae4fa1de46bce2fac1632d83a903a03560bc9cfe72e998da4ce28dbd1a2
IngestDate Wed Feb 19 02:31:29 EST 2025
IsPeerReviewed true
IsScholarly true
Issue 5
Keywords two-sample tests
area under the receiver operating characteristic curve
colorectal cancer biomarkers
limit of detection
Receiver operating characteristic curve analysis
Language English
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-c365t-8154ecae4fa1de46bce2fac1632d83a903a03560bc9cfe72e998da4ce28dbd1a2
ORCID 0000-0002-7480-1770
PMID 29635975
ParticipantIDs pubmed_primary_29635975
PublicationCentury 2000
PublicationDate 2019-05-00
PublicationDateYYYYMMDD 2019-05-01
PublicationDate_xml – month: 05
  year: 2019
  text: 2019-05-00
PublicationDecade 2010
PublicationPlace England
PublicationPlace_xml – name: England
PublicationTitle Statistical methods in medical research
PublicationTitleAlternate Stat Methods Med Res
PublicationYear 2019
SSID ssj0007049
Score 2.2095401
Snippet Assessment of the diagnostic accuracy of biomarkers through receiver operating characteristic curve analysis frequently involves a limit of detection imposed...
SourceID pubmed
SourceType Index Database
StartPage 1564
Title Bootstrap-based testing approaches for the assessment of the diagnostic accuracy of biomarkers subject to a limit of detection
URI https://www.ncbi.nlm.nih.gov/pubmed/29635975
Volume 28
hasFullText
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1Lb9QwELa2IKFyQLBAoTzkA7eVSx5O4hxbBKoQW_XQSr1VfkVUdDerTfbSQ38ev6szjhOHVRGPS7SyvVaU-eR5eOYbQj7EGvRqyi1LZJqDgxIJpiotmLBCVBm3oKXQUZyf5Mfn_OtFdjGZ_BxlLW1adaBv7q0r-R-pwhjIFatk_0Gyw6YwAL9BvvAECcPzr2R8VNcthipWDJWRmbVImYFFh54o3DZDFqEcGDj7rADTJdk5wlatN2vs-w5TWI-PKTvrZtZsFEZp0DyVs2ushMIFxrYufWs5tmvRZnWUz64YBZtSuzzbhb8G8pRCQ-jZtfOo2ald26t1F9m9VjJEZk_kDznmPmhCLvc3e6W_t10S9FCdE3pHnwLiXfR3jrksC1_o5sMaWEnVJxEe2O4o5kXBotSHOv1ZnYgRJrPRwYucN_drBHcnDY4a8v6APYO9H9NfloJMVwuHkAROI3Cwsj_PbnF091M7ZAe8FWy_ijEjbw8U4ISFC_KP26-CdNT-71uujTNxzp6SJ943oYcd0J6RiV1OyeP5QOzbTMmjuc_FmJLdQebNc3K7BUXqoUgDFClAkcJWNECR1pUbCVCkPRRxKkCReijStqaSOijiggGKL8j5l89nn46Zb-3BdJpnLRNguVstLa9kbCzPlbZJJTU4B4kRqSyjVEYpGONKl7qyRWLLUhjJYZUwysQyeUkeLOulfUVoDhrFZFlRmgIWxLBLpDIVa9BEivNSvSZ73Ue9XHX8LZf9597_7cwbshsw-ZY8rODAsO_A-mzVeyfcO-Jviq0
linkProvider National Library of Medicine
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Bootstrap-based+testing+approaches+for+the+assessment+of+the+diagnostic+accuracy+of+biomarkers+subject+to+a+limit+of+detection&rft.jtitle=Statistical+methods+in+medical+research&rft.au=Franco-Pereira%2C+Alba+M&rft.au=Nakas%2C+Christos+T&rft.au=Leichtle%2C+Alexander+B&rft.au=Pardo%2C+M+Carmen&rft.date=2019-05-01&rft.eissn=1477-0334&rft.volume=28&rft.issue=5&rft.spage=1564&rft_id=info:doi/10.1177%2F0962280218769334&rft_id=info%3Apmid%2F29635975&rft_id=info%3Apmid%2F29635975&rft.externalDocID=29635975