Scoring sacroiliac joints by magnetic resonance imaging. A multiple-reader reliability experiment
Magnetic resonance imaging (MRI) of the sacroiliac (SI) joints and the spine is increasingly important in the assessment of inflammatory activity and structural damage in clinical trials with patients with ankylosing spondylitis (AS). We investigated inter-reader reliability and sensitivity to chang...
Saved in:
Published in | Journal of rheumatology Vol. 32; no. 10; p. 2050 |
---|---|
Main Authors | , , , , , , , , , |
Format | Journal Article |
Language | English |
Published |
Canada
01.10.2005
|
Subjects | |
Online Access | Get more information |
Cover
Loading…
Abstract | Magnetic resonance imaging (MRI) of the sacroiliac (SI) joints and the spine is increasingly important in the assessment of inflammatory activity and structural damage in clinical trials with patients with ankylosing spondylitis (AS). We investigated inter-reader reliability and sensitivity to change of several scoring systems to assess disease activity and change in disease activity in patients with AS. Twenty sets of consecutive MRI, derived from a randomized clinical trial comparing an active drug with placebo and selected on the basis of the presence of activity at baseline, were presented electronically to 7 experienced readers from different countries (Europe, Canada). Readers scored the MRI by 3 different methods including: a global score (grading activity per SI joint); a more comprehensive global score (grading activity per SI joint per quadrant); and a detailed scoring system [Spondyloarthritis Research Consortium of Canada (SPARCC) scoring system], which scores 6 images, divided into quadrants, with additional scores for "depth" and "intensity." A fourth and a fifth scoring system were constructed afterwards. The fourth method included the SPARCC score minus the additional scores for "depth" and "intensity," and the fifth method included the SPARCC slice with the maximum score. Inter-reader reliability was investigated by calculating intraclass correlation coefficients (ICC) for all readers together and for all possible reader pairs. Sensitivity to change was investigated by calculating standardized response means (SRM) on change scores that were made positive. Overall inter-reader ICC per method were between 0.47 and 0.58 for scoring status, and between 0.40 and 0.53 for scoring change. ICC per possible reader pairs showed much more fluctuation per method, with lowest observed values close to zero (no agreement) and highest observed values over 0.80 (excellent agreement). In general, agreement of status scores was somewhat better than agreement of change scores, and agreement of the comprehensive SPARCC scoring system was somewhat better than agreement of the more condensed systems. Sensitivity to change differed per reader, but in general was somewhat better for the comprehensive SPARCC system. This experiment under "real life," far from optimal conditions demonstrates the feasibility of scoring exercises for method comparison, provides evidence for the reliability and sensitivity to change of scoring systems to be used in assessing activity of SI joints in clinical trials, and sets the conditions for further validation research in this field. |
---|---|
AbstractList | Magnetic resonance imaging (MRI) of the sacroiliac (SI) joints and the spine is increasingly important in the assessment of inflammatory activity and structural damage in clinical trials with patients with ankylosing spondylitis (AS). We investigated inter-reader reliability and sensitivity to change of several scoring systems to assess disease activity and change in disease activity in patients with AS. Twenty sets of consecutive MRI, derived from a randomized clinical trial comparing an active drug with placebo and selected on the basis of the presence of activity at baseline, were presented electronically to 7 experienced readers from different countries (Europe, Canada). Readers scored the MRI by 3 different methods including: a global score (grading activity per SI joint); a more comprehensive global score (grading activity per SI joint per quadrant); and a detailed scoring system [Spondyloarthritis Research Consortium of Canada (SPARCC) scoring system], which scores 6 images, divided into quadrants, with additional scores for "depth" and "intensity." A fourth and a fifth scoring system were constructed afterwards. The fourth method included the SPARCC score minus the additional scores for "depth" and "intensity," and the fifth method included the SPARCC slice with the maximum score. Inter-reader reliability was investigated by calculating intraclass correlation coefficients (ICC) for all readers together and for all possible reader pairs. Sensitivity to change was investigated by calculating standardized response means (SRM) on change scores that were made positive. Overall inter-reader ICC per method were between 0.47 and 0.58 for scoring status, and between 0.40 and 0.53 for scoring change. ICC per possible reader pairs showed much more fluctuation per method, with lowest observed values close to zero (no agreement) and highest observed values over 0.80 (excellent agreement). In general, agreement of status scores was somewhat better than agreement of change scores, and agreement of the comprehensive SPARCC scoring system was somewhat better than agreement of the more condensed systems. Sensitivity to change differed per reader, but in general was somewhat better for the comprehensive SPARCC system. This experiment under "real life," far from optimal conditions demonstrates the feasibility of scoring exercises for method comparison, provides evidence for the reliability and sensitivity to change of scoring systems to be used in assessing activity of SI joints in clinical trials, and sets the conditions for further validation research in this field. |
Author | Jurik, Anne-Grethe Østergaard, Mikkel Landewé, Robert B M van der Heijde, Désirée M F M Baraliakos, Xenophon Hermann, Kay-Geert A Braun, Jürgen Salonen, David C Lambert, Robert G Rudwaleit, Martin |
Author_xml | – sequence: 1 givenname: Robert B M surname: Landewé fullname: Landewé, Robert B M email: rlan@sint.azm.nl organization: Department of Internal Medicine, Division of Rheumatology, University Hospital Maastricht, University Maastricht, 6202 AZ Maastricht, The Netherlands. rlan@sint.azm.nl – sequence: 2 givenname: Kay-Geert A surname: Hermann fullname: Hermann, Kay-Geert A – sequence: 3 givenname: Désirée M F M surname: van der Heijde fullname: van der Heijde, Désirée M F M – sequence: 4 givenname: Xenophon surname: Baraliakos fullname: Baraliakos, Xenophon – sequence: 5 givenname: Anne-Grethe surname: Jurik fullname: Jurik, Anne-Grethe – sequence: 6 givenname: Robert G surname: Lambert fullname: Lambert, Robert G – sequence: 7 givenname: Mikkel surname: Østergaard fullname: Østergaard, Mikkel – sequence: 8 givenname: Martin surname: Rudwaleit fullname: Rudwaleit, Martin – sequence: 9 givenname: David C surname: Salonen fullname: Salonen, David C – sequence: 10 givenname: Jürgen surname: Braun fullname: Braun, Jürgen |
BackLink | https://www.ncbi.nlm.nih.gov/pubmed/16206369$$D View this record in MEDLINE/PubMed |
BookMark | eNo1T8tKxDAUzWLEeegvSH6gklfTdjkMvmDAhQruhuTmzpihTUuSAfv3BtTVgfPkrMkijAEXZMUkryuuxeeSrFM6M8a10u01WRaOaam7FTFvMEYfTjQZiKPvvQF6Hn3IidqZDuYUMHugEdMYTACkvnDFf0-3dLj02U89VhGNw1hMJW5LR54pfk8Y_YAh35Cro-kT3v7hhnw8Przvnqv969PLbruvvkTDcwVOcqNq0I0D0O4oBVplJWt1g0Ww0DGGUrpGtdAyyUCJjtvOKidqc7RabMjdb-90sQO6w1TmTZwP_1_FD0qrU0A |
ContentType | Journal Article |
DBID | CGR CUY CVF ECM EIF NPM |
DatabaseName | Medline MEDLINE MEDLINE (Ovid) MEDLINE MEDLINE PubMed |
DatabaseTitle | MEDLINE Medline Complete MEDLINE with Full Text PubMed MEDLINE (Ovid) |
DatabaseTitleList | MEDLINE |
Database_xml | – sequence: 1 dbid: NPM name: PubMed url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 2 dbid: EIF name: MEDLINE url: https://proxy.k.utb.cz/login?url=https://www.webofscience.com/wos/medline/basic-search sourceTypes: Index Database |
DeliveryMethod | no_fulltext_linktorsrc |
Discipline | Medicine |
ExternalDocumentID | 16206369 |
Genre | Validation Studies Journal Article Comparative Study |
GroupedDBID | --- .55 .GJ 0R~ 123 18M 1KJ 3O- 4.4 53G 5RE 6PF AAQQT AAWTL ABCQX ABJNI ACGFO ACGFS ADCBC AENEX AFFNX AI. ALMA_UNASSIGNED_HOLDINGS BR6 CGR CUY CVF EBS ECM EIF EJD EMOBN F5P H13 HZ~ J5H L7B MJL NPM O9- P0W P2P RHI SJN TJE VH1 W2D X7M XBR XDU XOL YCJ YQJ ZGI ZXE ZXP |
ID | FETCH-LOGICAL-h271t-cd31a45c67dcc6df32eb4b30867e1a4bc900e33d748c8030c4291b9b4d25afb62 |
ISSN | 0315-162X |
IngestDate | Sat Sep 28 07:50:59 EDT 2024 |
IsPeerReviewed | true |
IsScholarly | true |
Issue | 10 |
Language | English |
LinkModel | OpenURL |
MergedId | FETCHMERGED-LOGICAL-h271t-cd31a45c67dcc6df32eb4b30867e1a4bc900e33d748c8030c4291b9b4d25afb62 |
PMID | 16206369 |
ParticipantIDs | pubmed_primary_16206369 |
PublicationCentury | 2000 |
PublicationDate | 2005-10-01 |
PublicationDateYYYYMMDD | 2005-10-01 |
PublicationDate_xml | – month: 10 year: 2005 text: 2005-10-01 day: 01 |
PublicationDecade | 2000 |
PublicationPlace | Canada |
PublicationPlace_xml | – name: Canada |
PublicationTitle | Journal of rheumatology |
PublicationTitleAlternate | J Rheumatol |
PublicationYear | 2005 |
SSID | ssj0016468 |
Score | 2.1982036 |
Snippet | Magnetic resonance imaging (MRI) of the sacroiliac (SI) joints and the spine is increasingly important in the assessment of inflammatory activity and... |
SourceID | pubmed |
SourceType | Index Database |
StartPage | 2050 |
SubjectTerms | Humans Magnetic Resonance Imaging - methods Magnetic Resonance Imaging - standards Observer Variation Radiography Reproducibility of Results Rheumatology - methods Rheumatology - standards Sacroiliac Joint - pathology Sensitivity and Specificity Spondylitis, Ankylosing - diagnostic imaging |
Title | Scoring sacroiliac joints by magnetic resonance imaging. A multiple-reader reliability experiment |
URI | https://www.ncbi.nlm.nih.gov/pubmed/16206369 |
Volume | 32 |
hasFullText | |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1LT9wwELYWKqFeEC1QXq186G1llIdjb47QAquqcClIe0N-BQJsFu1DaPsT-qsZ23mxAgS9WJEdWVG-L5Px-JsxQt8DwZnQkSKAb0Ao-Mwk1ZEmQvfCLNVpop0Y8_SM9S_or0Ey6HT-tVRLs6ncV3-fzSv5H1ShD3C1WbLvQLaeFDrgGvCFFhCG9k0Y_1FePjcRYE7zu1yo7s0ot8IWcCqH4qowvkKzdbftB5wP3ZlE-2ANKiEhGTsts81pyX3J7nmr6v8Lruv42szA030Skf9to9EPft-9kWx3D9vhVpugUHgNx5ycGDteE8jmUdkH6Zv8xpcC_uknm-Tlbj4YoO5xM92hcDGaW68THJhiZGX2T6IYSa2Hq7O3Quhj7mj12jI3kc9ZrX4t7Wzgy9W2QL4fOpRhDvC6_PEvr48u1NmuhpbQEu9ZW3lm4z7lfhSjLqmyfkpba7a8f2E94vyS8zW0WqKCDzw7PqGOKT6jldNSMrGOREkS3JAEe5JgOccVSXBNElyRBB_gBZLgFklwQ5INdHF8dP6jT8pzNch1xMMpUToOBU0U41opprM4MpLKGBa33MCAVGkQmDjWnPZUD34CCnyWUKaS6igRmWTRJlouRoXZQpgzpnlCY3CCoc24ELGKYmpgnRtmgifb6It_OZf3vnjKZfXadl4c2UUfG4bsoQ8ZfK3mK7h-U_nNofIIWudciQ |
link.rule.ids | 786 |
linkProvider | National Library of Medicine |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Scoring+sacroiliac+joints+by+magnetic+resonance+imaging.+A+multiple-reader+reliability+experiment&rft.jtitle=Journal+of+rheumatology&rft.au=Landew%C3%A9%2C+Robert+B+M&rft.au=Hermann%2C+Kay-Geert+A&rft.au=van+der+Heijde%2C+D%C3%A9sir%C3%A9e+M+F+M&rft.au=Baraliakos%2C+Xenophon&rft.date=2005-10-01&rft.issn=0315-162X&rft.volume=32&rft.issue=10&rft.spage=2050&rft_id=info%3Apmid%2F16206369&rft_id=info%3Apmid%2F16206369&rft.externalDocID=16206369 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0315-162X&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0315-162X&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0315-162X&client=summon |