Mixing Interview and Questionnaire Methods: Practical Problems in Aligning Data

Structured questionnaires and semi-structured interviews are often used in mixed method studies to generate confirmatory results despite differences in methods of data collection, analysis, and interpretation. A review of 19 questionnaire-interview comparison studies found that consensus and consist...

Full description

Saved in:
Bibliographic Details
Published inPractical assessment, research & evaluation Vol. 15; no. 1; pp. 1 - 19
Main Authors Harris, Lois R, Brown, Gavin T. L
Format Journal Article
LanguageEnglish
Published College Park Dr 01.01.2010
Practical Assessment, Research and Evaluation, Inc
Subjects
Construct Validity
Data Analysis
Data Collection
English Teachers
Evaluation Methods
Foreign Countries
Interviews
Literature Reviews
Mathematics Teachers
New Zealand
Prompting
Questionnaires
Research Methodology
Semi Structured Interviews
Teacher Attitudes
Teaching Methods
Test Construction
Validity
New Zealand
Online AccessGet full text

Cover

More Information
Summary:Structured questionnaires and semi-structured interviews are often used in mixed method studies to generate confirmatory results despite differences in methods of data collection, analysis, and interpretation. A review of 19 questionnaire-interview comparison studies found that consensus and consistency statistics were generally weak between methods. Problems in aligning data from the two different methods are illustrated in a questionnaire-interview study of teacher conceptions of assessment. Poor alignment appeared attributable to: differences in data collection procedures, the complexity and instability of the construct being investigated, difficulties in making data comparable, lack of variability in participant responses, greater sensitivity to context and seemingly emotive responses within the interview, possible misinterpretation of some questionnaire prompts, and greater control of content exposure in the questionnaire. Results indicated that if "confirmatory" results are being sought, researchers must create tightly aligned and structured instruments; present the construct in a simple, concrete, and highly contextualised manner; collect the two types of data with a minimal time gap; and estimate agreement between methods using consistency statistics. However, the cost of confirmation through strong alignment may lead to the loss of rich complementary data obtained through allowing each method to be analysed in its own right. (Contains 3 tables.)
ISSN:1531-7714
1531-7714