Poor Reviews May Not Give a True Reflection of the Evidence

The predominance of poor systematic reviews in the current research literature is an unfortunate development, particularly in the light of the undoubtedly excellent work of the Cochrane Collaboration. The quality of any review depends entirely on the quality of the research work included. A common d...

Full description

Saved in:
Bibliographic Details
Published inPhysiotherapy Vol. 87; no. 10; pp. 549 - 551
Main Authors Hopwood, Val, White, Peter
Format Journal Article
LanguageEnglish
Published London Elsevier Ltd 01.10.2001
Chartered Society of Physiotherapy
Subjects
Online AccessGet full text

Cover

Loading…
Abstract The predominance of poor systematic reviews in the current research literature is an unfortunate development, particularly in the light of the undoubtedly excellent work of the Cochrane Collaboration. The quality of any review depends entirely on the quality of the research work included. A common dismissive comment about this type of review is ‘Garbage in, garbage out'. It is therefore the responsibility of all researchers to make sure that this cannot apply to their own work. A literature review of the effectiveness of four modalities commonly used to relieve pain was published in the August 2001 issue of Physiotherapy. That paper originated as part of an informal workshop held at the World Confederation for Physical Therapy Congress in Japan in May 2000. This should have been made clear in the published format, as several aspects of it, particularly with regard to acupuncture, may cause concern. This opinion piece was originally written as a letter in response to publication of the WCPT report. Unfortunately the shortcomings evident in it are quite common and should lead us to consider very carefully any claims as to clinical efficacy, or lack ot it, in the acupuncture field.
AbstractList The predominance of poor systematic reviews in the current research literature is an unfortunate development, particularly in the light of the undoubtedly excellent work of the Cochrane Collaboration. The quality of any review depends entirely on the quality of the research work included. A common dismissive comment about this type of review is ‘Garbage in, garbage out'. It is therefore the responsibility of all researchers to make sure that this cannot apply to their own work. A literature review of the effectiveness of four modalities commonly used to relieve pain was published in the August 2001 issue of Physiotherapy. That paper originated as part of an informal workshop held at the World Confederation for Physical Therapy Congress in Japan in May 2000. This should have been made clear in the published format, as several aspects of it, particularly with regard to acupuncture, may cause concern. This opinion piece was originally written as a letter in response to publication of the WCPT report. Unfortunately the shortcomings evident in it are quite common and should lead us to consider very carefully any claims as to clinical efficacy, or lack ot it, in the acupuncture field.
The quality of any review depends entirely on the quality of the research work included. A common dismissive comment about this type of review is 'garbage in, garbage out'. It is therefore the responsibility of all researchers to make sure that this cannot apply to their own work. A literature review of the effectiveness of four modalities commonly used to relieve pain was published in 'Physiotherapy' August 2001. That paper originated as part of an informal workshop held at the World Confederation for Physical Therapy Congress in Japan in May 2000. This should have been made clear in the published format, as several aspects of it, particularly with regard to acupuncture, may cause concern. This opinion piece was originally written as a letter response to publication of the WCPT report. Calls for careful consideration in any claims as to clinical efficacy, or lack of it, in the acupuncture field. (Original abstract - amended)
Author Hopwood, Val
White, Peter
Author_xml – sequence: 1
  givenname: Val
  surname: Hopwood
  fullname: Hopwood, Val
– sequence: 2
  givenname: Peter
  surname: White
  fullname: White, Peter
BackLink http://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=13516068$$DView record in Pascal Francis
BookMark eNqFkMtOwzAQRS1UJNrCJyB5A4JFwI4fScQCoaoUJF6CsrYceyKM0rjYaVH_nvQhWLKaxZw7V3MGqNf4BhA6puSCEiov3whhNCk4kWdEnEvBBUvYHurTPGMJ5VL0UP8XOUCDGD8JSQXNaB9dvXgf8CssHXxH_KhX-Mm3eOKWgDWehgV0u6oG0zrfYF_h9gPweOksNAYO0X6l6whHuzlE77fj6egueXie3I9uHhKT5qxNRCpkyUnB8ryQpeTSFlJyntuM2pKXXKcpKUtphcwEYRnnqZaUExAmB24LyobodHt3HvzXAmKrZi4aqGvdgF9EJTKRsbwrGCKxBU3wMQao1Dy4mQ4rRYlaq1IbVWrtQRGhNqoU63InuwIdja6roBvj4l-YCSqJzDvuestB921nLKho3NqEdaFTpKx3_zT9AI25e60
CODEN PHSIAO
CitedBy_id crossref_primary_10_1179_174328809X452917
Cites_doi 10.1001/jama.282.11.1054
10.1016/S1082-3174(11)80073-5
10.1016/S0140-6736(97)10471-8
10.1016/S0140-6736(00)04337-3
10.1016/S0031-9406(05)65460-0
10.1016/S0304-3959(99)00304-8
10.1056/NEJM197508212930803
10.1016/0885-3924(94)90157-0
10.1016/S0140-6736(98)01085-X
10.1016/S0965-2299(98)80080-0
10.1016/S0140-6736(99)04149-5
ContentType Journal Article
Copyright 2001 Chartered Society of Physiotherapy
2002 INIST-CNRS
Copyright_xml – notice: 2001 Chartered Society of Physiotherapy
– notice: 2002 INIST-CNRS
DBID IQODW
AAYXX
CITATION
7QJ
DOI 10.1016/S0031-9406(05)65453-3
DatabaseName Pascal-Francis
CrossRef
Applied Social Sciences Index & Abstracts (ASSIA)
DatabaseTitle CrossRef
Applied Social Sciences Index and Abstracts (ASSIA)
DatabaseTitleList
Applied Social Sciences Index and Abstracts (ASSIA)
DeliveryMethod fulltext_linktorsrc
Discipline Physical Therapy
EISSN 1873-1465
EndPage 551
ExternalDocumentID 10_1016_S0031_9406_05_65453_3
13516068
S0031940605654533
GroupedDBID ---
--K
--M
-~X
.1-
.FO
.GJ
.~1
0R1
0R~
123
1B1
1CY
1KJ
1P~
1~.
1~5
4.4
457
4G.
53G
5RE
5VS
7-5
71M
8P~
9JM
AABNK
AACTN
AAEDT
AAEDW
AAIAV
AAIKJ
AAKOC
AALRI
AAOAW
AAQFI
AAQQT
AAQXK
AAWTL
AAXUO
ABBQC
ABJNI
ABLVK
ABMAC
ABMZM
ABXDB
ABYKQ
ACDAQ
ACGFS
ACJTP
ACRLP
ADBBV
ADCBC
ADEZE
ADMUD
AEBSH
AEKER
AENEX
AEULQ
AEVXI
AFCTW
AFFNX
AFKWA
AFRHN
AFTJW
AFXBA
AFXIZ
AGHFR
AGUBO
AGYEJ
AIEXJ
AIKHN
AISVY
AITUG
AJBFU
AJOXV
AJRQY
AJUYK
ALMA_UNASSIGNED_HOLDINGS
AMFUW
AMRAJ
ANZVX
ASPBG
AVWKF
AXJTR
AZFZN
BKOJK
BLXMC
BNPGV
CS3
DU5
EBS
EFJIC
EFLBG
EJD
EO8
EO9
EP2
EP3
F5P
FDB
FEDTE
FGOYB
FIRID
FNPLU
FYGXN
G-Q
GBLVA
HVGLF
HX~
HZ~
IHE
J1W
J5H
KOM
LCYCR
M41
MO0
N9A
NAHTW
O-L
O9-
OAUVE
OH.
OT.
OZT
P-8
P-9
P2P
PC.
Q38
QZG
R2-
RIG
ROL
RPZ
SDF
SDG
SEL
SES
SEW
SNG
SPCBC
SSH
SSZ
T5K
TWZ
UAP
WH7
YCJ
Z5R
ZA5
ZGI
ZXP
~G-
AAPBV
ABPIF
AKALU
IQODW
AAXKI
AAYXX
ADVLN
AFJKZ
AKRWK
CITATION
7QJ
ID FETCH-LOGICAL-c283t-5256b40938896b646d966448d71db4b4a220bb6d5675037442a6140e5c8e4d913
IEDL.DBID AIKHN
ISSN 0031-9406
IngestDate Fri Aug 16 10:38:46 EDT 2024
Thu Sep 26 17:46:26 EDT 2024
Sun Oct 22 16:08:07 EDT 2023
Fri Feb 23 02:16:10 EST 2024
IsPeerReviewed true
IsScholarly true
Issue 10
Keywords meta-analysis
acupuncture
Systematic review
quality
Human
Analgesia
Pain
Folk medicine
Methodology
Oriental medicine
Quality
Acupuncture
Review
Bibliographic review
Metaanalysis
Language English
License CC BY 4.0
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c283t-5256b40938896b646d966448d71db4b4a220bb6d5675037442a6140e5c8e4d913
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
PQID 57573809
PQPubID 24071
PageCount 3
ParticipantIDs proquest_miscellaneous_57573809
crossref_primary_10_1016_S0031_9406_05_65453_3
pascalfrancis_primary_13516068
elsevier_sciencedirect_doi_10_1016_S0031_9406_05_65453_3
PublicationCentury 2000
PublicationDate 20011001
PublicationDateYYYYMMDD 2001-10-01
PublicationDate_xml – month: 10
  year: 2001
  text: 20011001
  day: 01
PublicationDecade 2000
PublicationPlace London
PublicationPlace_xml – name: London
PublicationTitle Physiotherapy
PublicationYear 2001
Publisher Elsevier Ltd
Chartered Society of Physiotherapy
Publisher_xml – name: Elsevier Ltd
– name: Chartered Society of Physiotherapy
References Gallacchi, Muller, Plattner, Schnorrenberger (bib3) 1981; 111
Naslund (bib10) 2001; 87
Streitberger, Kleinhenz (bib11) 1998; 352
Lewith, Vincent (bib6) 1995; 4
Ezzo, Berman, Hadhazy, Jadad, Lao, Singh (bib2) 2000; 86
Wood, Lewith (bib12) 1998; 6
Moher, Schulz, Altman (bib9) 2001; 357
Juni, Witschi, Bloch, Egger (bib5) 1999; 282
Ernst (bib1) 1994; 9
Moher, Cook, Eastwood, Olkin, Rennie, Stroup (bib7) 1999; 354
Moher, Pham, Jones, Cook, Jadad, Moher, Tugwell (bib8) 1998; 352
Gaw, Chang, Shaw (bib4) 1975; 293
Ernst (10.1016/S0031-9406(05)65453-3_bib1) 1994; 9
Gallacchi (10.1016/S0031-9406(05)65453-3_bib3) 1981; 111
Wood (10.1016/S0031-9406(05)65453-3_bib12) 1998; 6
Moher (10.1016/S0031-9406(05)65453-3_bib8) 1998; 352
Gaw (10.1016/S0031-9406(05)65453-3_bib4) 1975; 293
Juni (10.1016/S0031-9406(05)65453-3_bib5) 1999; 282
Naslund (10.1016/S0031-9406(05)65453-3_bib10) 2001; 87
Streitberger (10.1016/S0031-9406(05)65453-3_bib11) 1998; 352
Moher (10.1016/S0031-9406(05)65453-3_bib9) 2001; 357
Ezzo (10.1016/S0031-9406(05)65453-3_bib2) 2000; 86
Lewith (10.1016/S0031-9406(05)65453-3_bib6) 1995; 4
Moher (10.1016/S0031-9406(05)65453-3_bib7) 1999; 354
References_xml – volume: 357
  start-page: 1191
  year: 2001
  end-page: 1194
  ident: bib9
  article-title: ‘The CONSORT statement: Revised recommendations for improving the quality of reports of parallel group randomised trials’
  publication-title: Lancet
  contributor:
    fullname: Altman
– volume: 86
  start-page: 217
  year: 2000
  end-page: 225
  ident: bib2
  article-title: ‘Is acupuncture effective for the treatment of chronic pain? A systematic review’
  publication-title: Pain
  contributor:
    fullname: Singh
– volume: 352
  start-page: 364
  year: 1998
  end-page: 365
  ident: bib11
  article-title: ‘Introducing a placebo needle into acupuncture research’
  publication-title: Lancet
  contributor:
    fullname: Kleinhenz
– volume: 282
  start-page: 1054
  year: 1999
  end-page: 1060
  ident: bib5
  article-title: ‘The hazards of scoring the quality of clinical trials for meta-analysis’
  publication-title: JAMA
  contributor:
    fullname: Egger
– volume: 293
  start-page: 375
  year: 1975
  end-page: 378
  ident: bib4
  article-title: ‘Efficacy of acupuncture on osteo-arthritic pain: A controlled, double-blind study’
  publication-title: New England Journal of Medicine
  contributor:
    fullname: Shaw
– volume: 6
  start-page: 79
  year: 1998
  end-page: 82
  ident: bib12
  article-title: ‘The credibility of placebo controls in acupuncture studies’
  publication-title: Complementary Therapies in Medicine
  contributor:
    fullname: Lewith
– volume: 9
  start-page: 72
  year: 1994
  end-page: 74
  ident: bib1
  article-title: ‘Is acupuncture effective for pain control?’ (letter)
  publication-title: Journal of Pain Symptom Management
  contributor:
    fullname: Ernst
– volume: 111
  start-page: 1360
  year: 1981
  end-page: 1366
  ident: bib3
  article-title: ‘Akupunktur und Laserstrahlbehandlung beim Zervikal und Lumbalsyndrom’
  publication-title: Schweizer medizin Wochenschrift
  contributor:
    fullname: Schnorrenberger
– volume: 4
  start-page: 29
  year: 1995
  end-page: 39
  ident: bib6
  article-title: ‘Evaluation of the clinical effects of acupuncture: A problem reassessed and a framework for future research’
  publication-title: Pain Forum
  contributor:
    fullname: Vincent
– volume: 87
  start-page: 413
  year: 2001
  end-page: 423
  ident: bib10
  article-title: ‘Modes of sensory stimulation: Clinical trials and physiological aspects’
  publication-title: Physiotherapy
  contributor:
    fullname: Naslund
– volume: 354
  start-page: 1896
  year: 1999
  end-page: 1900
  ident: bib7
  article-title: ‘Improving the quality of reports of meta-analyses of randomised controlled trials: The QUORUM statement’
  publication-title: Lancet
  contributor:
    fullname: Stroup
– volume: 352
  start-page: 609
  year: 1998
  end-page: 613
  ident: bib8
  article-title: ‘Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analysis?’
  publication-title: Lancet
  contributor:
    fullname: Tugwell
– volume: 282
  start-page: 1054
  year: 1999
  ident: 10.1016/S0031-9406(05)65453-3_bib5
  article-title: ‘The hazards of scoring the quality of clinical trials for meta-analysis’
  publication-title: JAMA
  doi: 10.1001/jama.282.11.1054
  contributor:
    fullname: Juni
– volume: 4
  start-page: 29
  issue: 1
  year: 1995
  ident: 10.1016/S0031-9406(05)65453-3_bib6
  article-title: ‘Evaluation of the clinical effects of acupuncture: A problem reassessed and a framework for future research’
  publication-title: Pain Forum
  doi: 10.1016/S1082-3174(11)80073-5
  contributor:
    fullname: Lewith
– volume: 352
  start-page: 364
  issue: 9125
  year: 1998
  ident: 10.1016/S0031-9406(05)65453-3_bib11
  article-title: ‘Introducing a placebo needle into acupuncture research’
  publication-title: Lancet
  doi: 10.1016/S0140-6736(97)10471-8
  contributor:
    fullname: Streitberger
– volume: 111
  start-page: 1360
  issue: 37
  year: 1981
  ident: 10.1016/S0031-9406(05)65453-3_bib3
  article-title: ‘Akupunktur und Laserstrahlbehandlung beim Zervikal und Lumbalsyndrom’
  publication-title: Schweizer medizin Wochenschrift
  contributor:
    fullname: Gallacchi
– volume: 357
  start-page: 1191
  year: 2001
  ident: 10.1016/S0031-9406(05)65453-3_bib9
  article-title: ‘The CONSORT statement: Revised recommendations for improving the quality of reports of parallel group randomised trials’
  publication-title: Lancet
  doi: 10.1016/S0140-6736(00)04337-3
  contributor:
    fullname: Moher
– volume: 87
  start-page: 413
  issue: 8
  year: 2001
  ident: 10.1016/S0031-9406(05)65453-3_bib10
  article-title: ‘Modes of sensory stimulation: Clinical trials and physiological aspects’
  publication-title: Physiotherapy
  doi: 10.1016/S0031-9406(05)65460-0
  contributor:
    fullname: Naslund
– volume: 86
  start-page: 217
  year: 2000
  ident: 10.1016/S0031-9406(05)65453-3_bib2
  article-title: ‘Is acupuncture effective for the treatment of chronic pain? A systematic review’
  publication-title: Pain
  doi: 10.1016/S0304-3959(99)00304-8
  contributor:
    fullname: Ezzo
– volume: 293
  start-page: 375
  issue: 8
  year: 1975
  ident: 10.1016/S0031-9406(05)65453-3_bib4
  article-title: ‘Efficacy of acupuncture on osteo-arthritic pain: A controlled, double-blind study’
  publication-title: New England Journal of Medicine
  doi: 10.1056/NEJM197508212930803
  contributor:
    fullname: Gaw
– volume: 9
  start-page: 72
  issue: 2
  year: 1994
  ident: 10.1016/S0031-9406(05)65453-3_bib1
  article-title: ‘Is acupuncture effective for pain control?’ (letter)
  publication-title: Journal of Pain Symptom Management
  doi: 10.1016/0885-3924(94)90157-0
  contributor:
    fullname: Ernst
– volume: 352
  start-page: 609
  year: 1998
  ident: 10.1016/S0031-9406(05)65453-3_bib8
  article-title: ‘Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analysis?’
  publication-title: Lancet
  doi: 10.1016/S0140-6736(98)01085-X
  contributor:
    fullname: Moher
– volume: 6
  start-page: 79
  year: 1998
  ident: 10.1016/S0031-9406(05)65453-3_bib12
  article-title: ‘The credibility of placebo controls in acupuncture studies’
  publication-title: Complementary Therapies in Medicine
  doi: 10.1016/S0965-2299(98)80080-0
  contributor:
    fullname: Wood
– volume: 354
  start-page: 1896
  year: 1999
  ident: 10.1016/S0031-9406(05)65453-3_bib7
  article-title: ‘Improving the quality of reports of meta-analyses of randomised controlled trials: The QUORUM statement’
  publication-title: Lancet
  doi: 10.1016/S0140-6736(99)04149-5
  contributor:
    fullname: Moher
SSID ssj0025171
Score 1.594417
Snippet The predominance of poor systematic reviews in the current research literature is an unfortunate development, particularly in the light of the undoubtedly...
The quality of any review depends entirely on the quality of the research work included. A common dismissive comment about this type of review is 'garbage in,...
SourceID proquest
crossref
pascalfrancis
elsevier
SourceType Aggregation Database
Index Database
Publisher
StartPage 549
SubjectTerms Acupuncture
Biological and medical sciences
Medical sciences
meta-analysis
Miscellaneous
Physiotherapy
quality
Radiotherapy. Instrumental treatment. Physiotherapy. Reeducation. Rehabilitation, orthophony, crenotherapy. Diet therapy and various other treatments (general aspects)
Systematic review
Title Poor Reviews May Not Give a True Reflection of the Evidence
URI https://dx.doi.org/10.1016/S0031-9406(05)65453-3
https://search.proquest.com/docview/57573809
Volume 87
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1LS8NAEB5qexHEt1gfdQ8e9JC6yT6DpyLWqlh6qNDbknQ3IEhSbHvw4m938rKIiOB1w-6GbzbzfcPOZADOQ5roJKBTtIBlHg9s4mnJfQ_JPBGhk0qpvFD4aSgHz_xhIiYNuKlrYfK0ysr3lz698NbVyFWF5tXs5SWv8cXjg3yEFI4ygLE1aCEdcd6EVu_-cTD8iruEr8rGeSzvKE_lqpCnXKQYvKDisljHY79R1MYsmiNwSdnx4ofzLhipvw2blZQkvfJtd6Dh0l3YGlXAk3H5v4A9uB5l2RspLwHm5Cl6J8NsQe7QzZGIjN-WDp8lr0VKVkqyhKAkJHWz0X147t-ObwZe1TPBm6JQWGBcKWSMMRvTOpSx5NJiPIMhmFW-jXnMoyCgcSytkPkFpuI8iJCgqRNT7bgNfXYAzTRL3SGQILTK-cyqSFtuFQ1prHC-chxVjQ5pG7o1TGZW_hrDrHLGEFeT42qoMAWuhrVB12CabzY26L7_mtr5Bv5qQyZ8jMF0G85qaxj8QPJbjyh12XJuUI8qpml49P_dj2G9SD0rcvhOoLlA05yiFlnEHVjrfvid6sR9Ampm1F4
link.rule.ids 315,786,790,4521,24144,27955,27956,45618,45712
linkProvider Elsevier
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1LS8QwEB50PSiIb3F95uBBD9W0SZMUTyKu62MXDyt4C-0mhQVpF3c9ePG3O0lbFxERvLYkKd-kM9-QbzIAxwnNVR7RIVrAsIBHJg-U4GGAwTyPEyuklK5QuNcX3Sd-9xw_z8FVUwvjZJW17698uvfW9ZPzGs3z8Wjkanxx-2A8whCONICxeVhwbMDpus4-vnQe7kquqm0ec_3kqZiV8VRT-IcnND71swTstwC1PE4nCFte9bv44bp9POqswUpNJMll9a3rMGeLDVh9rGEng-q2gE24eCzLV1IdAUxIL30n_XJKbtDJkZQMXt8svstfvCCrIGVOkBCSptXoFjx1rgdX3aDumBAMkSZMMauMRYYZG1MqEZngwmA2gwmYkaHJeMbTKKJZJkws3PGl5DxKMTxTGw-V5SYJ2Ta0irKwO0CixEgbMiNTZbiRNKGZxPHScuQ0KqFtOGtg0uPqYgw9U4whrtrhqmmsPa6atUE1YOpvFtbovP8aevgN_NmCLA4xA1NtOGqsofH3cGceaWHLt4lGNiqZosnu_1c_gsXuoPegH27793uw5EVoXs23D60pmukAWck0O_S77hM8DNUz
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Poor+reviews+May+not+give+a+true+reflection+of+the+evidence&rft.jtitle=Physiotherapy&rft.au=HOPWOOD%2C+Val&rft.au=WHITE%2C+Peter&rft.date=2001-10-01&rft.pub=Chartered+Society+of+Physiotherapy&rft.issn=0031-9406&rft.eissn=1873-1465&rft.volume=87&rft.issue=10&rft.spage=549&rft.epage=551&rft_id=info:doi/10.1016%2FS0031-9406%2805%2965453-3&rft.externalDBID=n%2Fa&rft.externalDocID=13516068
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0031-9406&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0031-9406&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0031-9406&client=summon