Interobserver Agreement and Disagreement in Continuous Recording Exemplified by Measurement of Behavior State

Continuous observational recording over 57 hours evaluated behavior states of three adults with profound and multiple disabilities. Two independent observers also recorded for 22 hours. Although overall percentage agreement was satisfactory (above 80%), agreement on occurrence was unsatisfactory (me...

Full description

Saved in:
Bibliographic Details
Published inAmerican journal of mental retardation Vol. 102; no. 1; p. 54
Main Authors Mudford, Oliver C, Hogg, James, Roberts, Jessica
Format Journal Article
LanguageEnglish
Published United States 01.07.1997
Subjects
Adult
Arousal - physiology
Behavior - classification
Data Analysis
Data Collection
Epilepsy - complications
Epilepsy - physiopathology
Evaluation Methods
Humans
Intellectual Disability - complications
Intellectual Disability - physiopathology
Interrater Reliability
Male
Measurement Techniques
Motor Activity - physiology
Multiple Disabilities
Observation
Observer Variation
Paralysis - complications
Paralysis - physiopathology
Research Methodology
Seizures - physiopathology
Severe Disabilities
Severe Mental Retardation
Sleep - physiology
Time Factors
Online AccessGet more information
ISSN0895-8017
DOI10.1352/0895-8017(1997)102<0054:IAADIC>2.0.CO;2

Cover

Abstract Continuous observational recording over 57 hours evaluated behavior states of three adults with profound and multiple disabilities. Two independent observers also recorded for 22 hours. Although overall percentage agreement was satisfactory (above 80%), agreement on occurrence was unsatisfactory (mean of 65%). Agreement data were superimposed on participants' behavior state profiles to demonstrate data analysis despite their generally inadequate reliability. (Author/DB)
AbstractList Continuous observational recording was used to measure behavior state of 3 adults with profound and multiple disabilities. Observations were made over 56.7 hours, including 21.9 hours with two observers recording independently. Overall percentage agreement was satisfactory (i.e., exceeded 80%). Agreement on occurrence was, however, generally unsatisfactory at a mean of 63.5%, with 5 of 16 Subject x State Agreement Indices over 80%. Percentage disagreement on occurrence, a previously unreported measure, was computed to quantify sources of disagreement. The agreement data were superimposed on participants' behavior state profiles to demonstrate how conclusions can be drawn from the data, despite their generally inadequate reliability. This approach to interobserver agreement and presentation of data is suggested for researchers investigating entities that are not directly amenable to observation.
Continuous observational recording over 57 hours evaluated behavior states of three adults with profound and multiple disabilities. Two independent observers also recorded for 22 hours. Although overall percentage agreement was satisfactory (above 80%), agreement on occurrence was unsatisfactory (mean of 65%). Agreement data were superimposed on participants' behavior state profiles to demonstrate data analysis despite their generally inadequate reliability. (Author/DB)
Author Hogg, James
Mudford, Oliver C
Roberts, Jessica
Author_xml – sequence: 1
  fullname: Mudford, Oliver C
– sequence: 2
  fullname: Hogg, James
– sequence: 3
  fullname: Roberts, Jessica
BackLink http://eric.ed.gov/ERICWebPortal/detail?accno=EJ550642$$DView record in ERIC
https://www.ncbi.nlm.nih.gov/pubmed/9241408$$D View this record in MEDLINE/PubMed
BookMark eNo9j11PwjAYhXuBQUD_gSa91IvB265lnRqTOVBnMCR-XJOue4c1rCPdIPLvJYFwdZLznHOS0ycdVzskZMRgyELJR6BiGShg0Q2L4-iWAX8AkOIuS5JJlj7yIQzT-T3vkN4peU76TfMLwHiswi7pxlwwAapHqsy16Ou8Qb9FT5OlR6zQtVS7gk5so0-GdTStXWvdpt409ANN7QvrlnT6h9V6ZUuLBc139B11s_GHSl3SJ_zRW1t7-tnqFi_IWalXDV4edUC-n6df6Wswm79kaTILTChUGxhQoYgLZvKxMAq0DBGMijiUWIZ5yfk4RmFyGULICwNGal2KKGJmj40UjA_I9WF3vckrLBZrbyvtd4vj7T2_OnD01pzo9E1KGAvO_wHoSWoy
ContentType Journal Article
DBID 7SW
BJH
BNH
BNI
BNJ
BNO
ERI
PET
REK
WWN
CGR
CUY
CVF
ECM
EIF
NPM
DOI 10.1352/0895-8017(1997)102<0054:IAADIC>2.0.CO;2
DatabaseName ERIC
ERIC (Ovid)
ERIC
ERIC
ERIC (Legacy Platform)
ERIC( SilverPlatter )
ERIC
ERIC PlusText (Legacy Platform)
Education Resources Information Center (ERIC)
ERIC
Medline
MEDLINE
MEDLINE (Ovid)
MEDLINE
MEDLINE
PubMed
DatabaseTitle ERIC
MEDLINE
Medline Complete
MEDLINE with Full Text
PubMed
MEDLINE (Ovid)
DatabaseTitleList MEDLINE
ERIC
Database_xml – sequence: 1
  dbid: NPM
  name: PubMed
  url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed
  sourceTypes: Index Database
– sequence: 2
  dbid: EIF
  name: MEDLINE
  url: https://proxy.k.utb.cz/login?url=https://www.webofscience.com/wos/medline/basic-search
  sourceTypes: Index Database
– sequence: 3
  dbid: ERI
  name: ERIC
  url: https://eric.ed.gov/
  sourceTypes: Index Database
DeliveryMethod no_fulltext_linktorsrc
Discipline Medicine
ERIC EJ550642
ExternalDocumentID 9241408
EJ550642
Genre Research Support, Non-U.S. Gov't
Journal Article
GroupedDBID --Z
-DZ
-W8
-~X
.GJ
.GO
07C
186
1KJ
23M
2FS
2KS
3EH
3PY
4.4
41~
53G
5GY
5RE
6J9
7SW
85S
9M8
AAHSB
AAIKC
AAMNW
AAWTL
ABDPE
ABPPZ
ACBNA
ACNCT
ADMHG
ADXHL
AFFNX
AGHSJ
AI.
ALEEW
ALMA_UNASSIGNED_HOLDINGS
BJH
BNH
BNI
BNJ
BNO
CS3
EBS
EJD
ERI
F5P
HF~
L7B
LPU
MVM
NEJ
NHB
OHT
OMK
P-O
PET
QF4
QM7
QN7
RAM
REK
TDBHL
TN5
TWZ
UBC
UHB
UPT
VH1
WH7
WHG
WWN
XJT
XOL
XSW
XZL
YQJ
YR5
YYQ
YZZ
ZCA
ZCG
ZGI
ZUP
ZXP
AAYOK
CGR
CUY
CVF
ECM
EIF
NPM
VXZ
Y3D
YCJ
YIN
Z5M
ID FETCH-LOGICAL-c348t-c08349d1cb64c80a53e0c8720fef3bf2269e4cb53032dc0c5aaf4771cef3c5412
IEDL.DBID ERI
ISSN 0895-8017
IngestDate Wed Feb 19 01:35:22 EST 2025
Tue Sep 02 19:19:01 EDT 2025
IsDoiOpenAccess false
IsOpenAccess false
IsPeerReviewed false
IsScholarly false
Issue 1
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c348t-c08349d1cb64c80a53e0c8720fef3bf2269e4cb53032dc0c5aaf4771cef3c5412
PMID 9241408
ParticipantIDs pubmed_primary_9241408
eric_primary_EJ550642
PublicationCentury 1900
PublicationDate 1997-07-01
PublicationDateYYYYMMDD 1997-07-01
PublicationDate_xml – month: 07
  year: 1997
  text: 1997-07-01
  day: 01
PublicationDecade 1990
PublicationPlace United States
PublicationPlace_xml – name: United States
PublicationTitle American journal of mental retardation
PublicationTitleAlternate Am J Ment Retard
PublicationYear 1997
References 11958203 - Am J Ment Retard. 2000 Nov;105(6):509-11
9678232 - Am J Ment Retard. 1998 Jul;103(1):75-9
References_xml – reference: 11958203 - Am J Ment Retard. 2000 Nov;105(6):509-11
– reference: 9678232 - Am J Ment Retard. 1998 Jul;103(1):75-9
SSID ssj0012983
Score 1.3035262
Snippet Continuous observational recording over 57 hours evaluated behavior states of three adults with profound and multiple disabilities. Two independent observers...
Continuous observational recording was used to measure behavior state of 3 adults with profound and multiple disabilities. Observations were made over 56.7...
SourceID pubmed
eric
SourceType Index Database
StartPage 54
SubjectTerms Adult
Arousal - physiology
Behavior - classification
Data Analysis
Data Collection
Epilepsy - complications
Epilepsy - physiopathology
Evaluation Methods
Humans
Intellectual Disability - complications
Intellectual Disability - physiopathology
Interrater Reliability
Male
Measurement Techniques
Motor Activity - physiology
Multiple Disabilities
Observation
Observer Variation
Paralysis - complications
Paralysis - physiopathology
Research Methodology
Seizures - physiopathology
Severe Disabilities
Severe Mental Retardation
Sleep - physiology
Time Factors
Title Interobserver Agreement and Disagreement in Continuous Recording Exemplified by Measurement of Behavior State
URI http://eric.ed.gov/ERICWebPortal/detail?accno=EJ550642
https://www.ncbi.nlm.nih.gov/pubmed/9241408
Volume 102
hasFullText
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3PS8MwFA5TYXgRf2w4f5GDBz1ktmmSpipC2Q-2QacHB7tJkyawg53MCfrf-9J2FQ-Clx4SSuGF5n3fy5fvIXQJEDSjxkoilWKEScGIirhHQsa5cH7tvnC3kZOpGM3YZM7nDbTp4vhfReWEO6M12Hq3KPU2pKc6O6BRab4pI-7237BZdT3m9KYeu3L6imtIrvcOs9yO47g_7j3QrtftPd7R4p56-YVaBv0LdBbJZ7iP9irUiONymQ9Qw-SHqJlU5-JH6LUo7C2VK7GaFY6BRBdlP5zmGe4v3tN6YJFjZ0i1yD-A8uOSfEL2woNP47TlFhApVl84-Skd4qXFlYviChfYtIVmw8Fzb0SqRgpEB0yuiQacxaLM10owLb2UB8bTMqSeNTZQFhBYZJhWHNIZzbSneZpaFoa-hmnNmU_baDtf5uYYYWMUC63wU8sNM0IoAQgr0EEkhbW-H3ZQy8Xr5a30ynjZxLGD2mUA6xkgfkDu5MkfL5yi3dIp1iljz9COhb_RnAMAWKuLYr3hOX1KvgE0bqnP
linkProvider ERIC Clearinghouse on Information & Technology
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Interobserver+Agreement+and+Disagreement+in+Continuous+Recording+Exemplified+by+Measurement+of+Behavior+State&rft.jtitle=American+journal+of+mental+retardation&rft.au=Mudford%2C+Oliver+C&rft.au=Hogg%2C+James&rft.au=Roberts%2C+Jessica&rft.date=1997-07-01&rft.issn=0895-8017&rft.volume=102&rft.issue=1&rft.spage=54&rft_id=info:doi/10.1352%2F0895-8017%281997%29102%3C0054%3AIAADIC%3E2.0.CO%3B2&rft.externalDocID=EJ550642
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0895-8017&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0895-8017&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0895-8017&client=summon