Multi-institutional external validation of urinary TWIST1 and NID2 methylation as a diagnostic test for bladder cancer

• Published in: Urologic oncology Vol. 33; no. 9; pp. 387.e1 - 387.e6
• Main Authors: Fantony, Joseph J., Abern, Michael R., Gopalakrishna, Ajay, Owusu, Richmond, Jack Tay, Kae, Lance, Raymond S., Inman, Brant A.
• Format: Journal Article
• Language: English
• Published: United States Elsevier Inc 01.09.2015
• Subjects: Aged; Area Under Curve; Biomarkers, Tumor - analysis; Carcinoma, Transitional Cell - diagnosis; Carcinoma, Transitional Cell - genetics; Carcinoma, Transitional Cell - urine; Cell Adhesion Molecules - genetics; Cell Adhesion Molecules - metabolism; Cell Adhesion Molecules - urine; Cohort Studies; Diagnostic test; DNA Methylation; Epigenetic; Female; Humans; Likelihood Functions; Male; Middle Aged; Nuclear Proteins - genetics; Nuclear Proteins - metabolism; Nuclear Proteins - urine; Real-Time Polymerase Chain Reaction; ROC Curve; Sensitivity; Sensitivity and Specificity; Smoking; Specificity; Twist-Related Protein 1 - genetics; Twist-Related Protein 1 - metabolism; Twist-Related Protein 1 - urine; Urinary Bladder Neoplasms - diagnosis; Urinary Bladder Neoplasms - genetics; Urinary Bladder Neoplasms - urine; Urology; Urothelial carcinoma; Diagnostic test; Sensitivity; Specificity; Epigenetic; Urothelial carcinoma; Smoking
• DOI: 10.1016/j.urolonc.2015.04.014
• ISSN: 1078-1439; 1873-2496

We previously reported a clinical trial in which we were unable to replicate the excellent diagnostic metrics produced in the developmental study of the TWIST1 and NID2 gene methylation assay. In this expanded trial with subjects enrolled from another institution, we reexamine the diagnostic capabilities of the test to externally validate our previous study. TWIST1 and NID2 gene methylation was assessed in DNA isolated from the urine of subjects at risk of bladder cancer undergoing cystoscopy for hematuria or bladder cancer surveillance. The diagnostic gold standard was cystoscopy. Two thresholds of TWIST1 and NID2 gene methylation were used for determining test result positivity, those published by Renard et al. and Abern et al. The sensitivity, specificity, positive and negative predictive values, diagnostic likelihood ratios, and receiver operating characteristic curves were calculated for each gene, as well as their combination. In all, 3 methods were used to combine TWIST1 and NID2 into a single composite test: (1) believe-the-positive decision rule—if either gene is methylated the test result is positive, which maximizes test sensitivity; (2) believe-the-negative decision rule—if either gene is not methylated the test result is negative, which maximizes test specificity; and (3) a likelihood-based logistic regression model approach that balances sensitivity and specificity. Clinical utility was determined using a decision curve analysis. A total of 209 subjects were evaluated: 40% for hematuria and 60% for bladder cancer surveillance. Approximately 75% were male, most of the prior cancers being low-grade Ta. Using cystoscopy as the gold standard, areas under the curve were 0.67 for TWIST1, 0.64 for NID2, and 0.66 for combined TWIST1 and NID2. Decision rule results revealed optimization of sensitivity at 67% using Renard thresholds and specificity using the Abern thresholds at 69%. We found improved sensitivity (78%) in current smokers. Decision curve analyses revealed that the methylation assay provided only a modest benefit even at high probabilities of missed cancer. A urine DNA test measuring TWIST1 and NID2 methylation was externally examined with a larger cohort and its results continue to be poor. These 2 biomarkers are unlikely to replace cystoscopy, but they may be worthy of study in active smokers. •This external validation with additional data from an outside institution corroborates our previous finding of poor performance of this methylation assay compared to the developmental publication.•There appears to be improved test performance in patients with higher grade disease, showing evidence of spectrum effects.•This study shows that multi-institutional testing of a diagnostic test is needed before wide-spread clinical use, as it may show lack of reproducibility in a “real-world” situation.•TWIST/NID2 may be of some diagnostic benefit in the subgroup of active smokers. This needs further study with a larger cohort.