Critical Appraisal of Research Literature by Expert and Inexperienced Physical Therapy Researchers

• Published in: Physical therapy Vol. 74; no. 9; pp. 853 - 860
• Main Authors: Domholdt, Elizabeth, Flaherty, Julianne Lonz, Phillips, James M
• Format: Journal Article
• Language: English
• Published: United States American Physical Therapy Association 01.09.1994; Oxford University Press
• Subjects: Health care policy; Medical research; Physical therapy; Physical Therapy Modalities - standards; Publishing; Publishing - standards
• ISSN: 0031-9023; 1538-6724
• DOI: 10.1093/ptj/74.9.853

In this study, critical appraisal skills of physical therapists who were inexperienced and expert researchers were compared and the effect of the following independent variables on the appraisal skills of novices was examined: years of physical therapy practice, postgraduate experience with research, level of comfort with research, journal reading habits, and content-specific expertise. Four expert and 20 inexperienced researchers critiqued the same research article. A content analysis of the expert critiques was used to develop a set of 12 items of concerns about the study. Experts identified a mean of 7.75 items of concern; novices identified a mean of 3.95 items. For 10 of the 12 items, a greater proportion of experts identified each concern compared with the novices. Novices had comparatively less difficulty identifying concerns with internal validity than they did identifying issues relating to construct validity. Only one of the variables--content-specific expertise--was associated with differences in critical appraisal skills among the novices. These finding suggest that analysis of construct issues in research articles is a more advanced skill than analysis of research design and that critical appraisal of research literature is enhanced by clinical experiences related to the subject of the research report.