Retrieval of overviews of systematic reviews in MEDLINE was improved by the development of an objectively derived and validated search strategy

• Published in: Journal of clinical epidemiology Vol. 74; pp. 107 - 118
• Main Authors: Lunny, Carole, McKenzie, Joanne E., McDonald, Steve
• Format: Journal Article
• Language: English
• Published: United States Elsevier Inc 01.06.2016; Elsevier Limited
• Subjects: Citations; Clinical medicine; Confidence intervals; Data Mining; Epidemiology; Evidence-Based Medicine; Frequency analysis; Humans; Information Storage and Retrieval - methods; Information Storage and Retrieval - statistics & numerical data; Internal Medicine; Medical Subject Headings-MeSH; MEDLINE; MEDLINE - statistics & numerical data; Meta-analysis; Overviews of systematic reviews; Population; Quality; Reproducibility of Results; Researchers; Review Literature as Topic; Search filter; Search strategy design; Sensitivity; Sensitivity and Specificity; Studies; Text mining; Text mining; MEDLINE; Sensitivity; Search strategy design; Search filter; Overviews of systematic reviews
• ISSN: 0895-4356; 1878-5921; 1878-5921
• DOI: 10.1016/j.jclinepi.2015.12.002

Locating overviews of systematic reviews is difficult because of an absence of appropriate indexing terms and inconsistent terminology used to describe overviews. Our objective was to develop a validated search strategy to retrieve overviews in MEDLINE. We derived a test set of overviews from the references of two method articles on overviews. Two population sets were used to identify discriminating terms, that is, terms that appear frequently in the test set but infrequently in two population sets of references found in MEDLINE. We used text mining to conduct a frequency analysis of terms appearing in the titles and abstracts. Candidate terms were combined and tested in MEDLINE in various permutations, and the performance of strategies measured using sensitivity and precision. Two search strategies were developed: a sensitivity-maximizing strategy, achieving 93% sensitivity (95% confidence interval [CI]: 87, 96) and 7% precision (95% CI: 6, 8), and a sensitivity-and-precision–maximizing strategy, achieving 66% sensitivity (95% CI: 58, 74) and 21% precision (95% CI: 17, 25). The developed search strategies enable users to more efficiently identify overviews of reviews compared to current strategies. Consistent language in describing overviews would aid in their identification, as would a specific MEDLINE Publication Type.