Assessment of a Rotating Time Sampling Procedure: Implications for Interobserver Agreement and Response Measurement

The current study was designed to evaluate a rotating momentary time sampling (MTS) data collection system. A rotating MTS system has been used to measure activity preferences of preschoolers but not to collect data on responses that vary in duration and frequency (e.g., talking). We collected data...

Full description

Saved in:
Bibliographic Details
Published inEducation & treatment of children Vol. 39; no. 1; pp. 1 - 20
Main Authors Becraft, Jessica L., Borrero, John C., Davis, Barbara J., Mendres-Smith, Amber E.
Format Journal Article
LanguageEnglish
Published New York WEST VIRGINIA UNIVERSITY PRESS 01.02.2016
West Virginia University Press
West Virginia University Press, University of West Virginia
Subjects
Applied Behavior Analysis
Behavior
Behavior Patterns
Children & youth
Computer simulation
Data Collection
Data entry
EXPERIMENTAL STUDIES
Interrater Reliability
Intervals
Measurement
Methods
Observation
Personal preferences (Social sciences)
Preschool Children
Psychological aspects
Psychological research
Replication (Evaluation)
Sampling
Speech
Students
Teachers
Time
Online AccessGet full text

Cover

More Information
Summary:The current study was designed to evaluate a rotating momentary time sampling (MTS) data collection system. A rotating MTS system has been used to measure activity preferences of preschoolers but not to collect data on responses that vary in duration and frequency (e.g., talking). We collected data on talking for 10 preschoolers using a 5-s MTS and interpolated larger MTS values. Results indicated that 30-, 60-, and 90-s intervals approximated the 5-s MTS. Next, we implemented a rotating MTS for each value in which we observed either 10 or 19 students. For all interval durations, there was high interval-by-interval interobserver agreement (IOA). However, we found overall low occurrence IOA. These results illustrate that it is important to consider which IOA algorithm is used, based on the type of data collected.
ISSN:0748-8491
1934-8924