Impact of covert duplicate publication on meta-analysis: a case study

• Published in: BMJ Vol. 315; no. 7109; pp. 635 - 640
• Main Authors: Tramèr, Martin R, Reynolds, D John M, Moore, R Andrew, McQuay, Henry J
• Format: Journal Article
• Language: English
• Published: London British Medical Journal Publishing Group 13.09.1997; British Medical Association; BMJ Publishing Group LTD; BMJ Publishing Group
• Edition: International edition
• Subjects: Analysis; Anesthesia; Antiemetics; Antiemetics - therapeutic use; Biological and medical sciences; Clinical trials; Confidence interval; Confidence intervals; Data tables; Digestive system; Dosage; Duplicate Publication as Topic; Experimentation; Health care; Humans; Medical research; Medical sciences; Meta analysis; Meta-Analysis as Topic; Nausea; Ondansetron - therapeutic use; Patients; Pharmacology. Drug treatments; Placebos; Postoperative Complications - prevention & control; Postoperative nausea; Prevention; Randomized Controlled Trials as Topic; Surgery; Treatment Outcome; Vomiting; Vomiting - prevention & control; Human; Postoperative; Evaluation; Iatrogenic; Duplication; Treatment efficiency; Controlled therapeutic trial; Metaanalysis; Chemotherapy; Treatment; Vomiting; Digestive diseases; Complication; Antagonist; Antiemetic; Ondansetron; 5-HT3 receptor
• ISSN: 0959-8138; 0959-8146; 1468-5833; 1756-1833
• DOI: 10.1136/bmj.315.7109.635

Abstract Objective: To quantify the impact of duplicate data on estimates of efficacy. Design: Systematic search for published full reports of randomised controlled trials investigating ondansetron's effect on postoperative emesis. Abstracts were not considered. Data sources: Eighty four trials (11 980 patients receiving ondansetron) published between 1991 and September 1996. Main outcome measures: Percentage of duplicated trials and patient data. Estimation of antiemetic efficacy (prevention of emesis) of the most duplicated ondansetron regimen. Comparison between the efficacy of non-duplicated and duplicated data. Results: Data from nine trials had been published in 14 further reports, duplicating data from 3335 patients receiving ondansetron; none used a clear cross reference. Intravenous ondansetron 4 mg versus placebo was investigated in 16 reports not subject to duplicate publication, three reports subject to duplicate publication, and six duplicates of those three reports. The number needed to treat to prevent vomiting within 24 hours was 9.5 (95% confidence interval 6.9 to 15) in the 16 non-duplicated reports and 3.9 (3.3 to 4.8) in the three reports which were duplicated (P<0.00001). When these 19 were combined the number needed to treat was 6.4 (5.3 to 7.9). When all original and duplicate reports were combined (n=25) the apparent number needed to treat improved to 4.9 (4.4 to 5.6). Conclusions: By searching systematically we found 17% of published full reports of randomised trials and 28% of the patient data were duplicated. Trials reporting greater treatment effect were significantly more likely to be duplicated. Inclusion of duplicated data in meta-analysis led to a 23% overestimation of ondansetron's antiemetic efficacy. Key messages Although publishing the same data more than once is strongly discouraged, there is no evidence of the impact of duplicate data on meta-analysis Re-analysing an important trial, and cross referencing to original reports (overt duplication), may be necessary and valuable in some circumstances Covert duplication, masked by change of authors, of language, or by adding extra data, causes problems. One danger is that patient data are analysed more than once in meta-analysis 17% of systematically searched randomised trials of ondansetron as a postoperative antiemetic were covert duplicates and resulted in 28% of patient data being duplicated. None of these reports cross references the original source. Duplication lead to an overestimation of ondansetron's antiemetic efficacy of 23%. Trials reporting greater treatment effect were significantly more likely to be duplicated Covert duplication of data has major implications for the assessment of drug efficacy and safety