Speed, accuracy, and confidence in Google, Ovid, PubMed, and UpToDate: results of a randomised trial

• Published in: Postgraduate medical journal Vol. 86; no. 1018; pp. 459 - 465
• Main Authors: Thiele, Robert H, Poiro, Nathan C, Scalzo, David C, Nemergut, Edward C
• Format: Journal Article
• Language: English
• Published: London The Fellowship of Postgraduate Medicine 01.08.2010; BMJ Publishing Group; Oxford University Press
• Subjects: Adult; anaesthetics; Anesthesia - methods; Biological and medical sciences; biotechnology and bioinformatics; Critical Care - methods; Data analysis; Data collection; Databases, Bibliographic - standards; education; Evidence-Based Medicine - methods; Female; General aspects; Humans; Information science (MeSH tree number L01); information technology; Internet; internet (L01.224.230.110.500); Internet - standards; Male; medical (I02.358.399); medical education and training; Medical sciences; Medical students; Mental Competency; PubMed - standards; Regression analysis; Review boards; search engine (L01.470.875); Search engines; Search strategies; Terminology as Topic; Time Factors; world wide web technology; Medicine; Speed; Accuracy; Randomization; Confidence; Clinical trial; Internet; Web site; Result
• ISSN: 0032-5473; 1469-0756; 1469-0756
• DOI: 10.1136/pgmj.2010.098053

BackgroundThe explosion of biomedical information has led to an ‘information paradox’—the volume of biomedical information available has made it increasingly difficult to find relevant information when needed. It is thus increasingly critical for physicians to acquire a working knowledge of biomedical informatics.AimTo evaluate four search tools commonly used to answer clinical questions, in terms of accuracy, speed, and user confidence.MethodsFrom December 2008 to June 2009, medical students, resident physicians, and attending physicians at the authors' institution were asked to answer a set of four anaesthesia and/or critical care based clinical questions, within 5 min, using Google, Ovid, PubMed, or UpToDate (only one search tool per question). At the end of each search, participants rated their results on a four point confidence scale. One to 3 weeks after answering the initial four questions, users were randomised to one of the four search tools, and asked to answer eight questions, four of which were repeated. The primary outcome was defined as a correct answer with the highest level of confidence.ResultsGoogle was the most popular search tool. Users of Google and UpToDate were more likely than users of PubMed to answer questions correctly. Subjects had the most confidence in UpToDate. Searches with Google and UpToDate were faster than searches with PubMed or Ovid.ConclusionNon-Medline based search tools are not inferior to Medline based search tools for purposes of answering evidence based anaesthesia and critical care questions.