What is behind a summary-evaluation decision?

Research in psychology has reported that, among the variety of possibilities for assessment methodologies, summary evaluation offers a particularly adequate context for inferring text comprehension and topic understanding. However, grades obtained in this methodology are hard to quantify objectively...

Full description

Saved in:
Bibliographic Details
Published inBehavior research methods Vol. 40; no. 2; pp. 597 - 612
Main Authors Zipitria, Iraide, Larrañaga, Pedro, Armañanzas, Ruben, Arruarte, Ana, Elorriaga, Jon A.
Format Journal Article
LanguageEnglish
Published New York Springer-Verlag 01.05.2008
Psychonomic Society, Inc
Subjects
Ability
Algorithms
Bayes Theorem
Behavioral Science and Psychology
Cognitive Psychology
Comprehension
Decision Making
Educational evaluation
Educational Measurement - methods
Experts
Humans
Language Tests
Models, Psychological
Nonfiction
Psychology
Psychology, Experimental
Task Performance and Analysis
Variables
Text Comprehension
Global Score
Bayesian Classifier
Bayesian Network
Reading Text
Online AccessGet full text

Cover

More Information
Summary:Research in psychology has reported that, among the variety of possibilities for assessment methodologies, summary evaluation offers a particularly adequate context for inferring text comprehension and topic understanding. However, grades obtained in this methodology are hard to quantify objectively. Therefore, we carried out an empirical study to analyze the decisions underlying human summary-grading behavior. The task consisted of expert evaluation of summaries produced in critically relevant contexts of summarization development, and the resulting data were modeled by means of Bayesian networks using an application called Elvira, which allows for graphically observing the predictive power (if any) of the resultant variables. Thus, in this article, we analyzed summary-evaluation decision making in a computational framework.
Bibliography:ObjectType-Article-2
SourceType-Scholarly Journals-1
ObjectType-Feature-1
content type line 23
ObjectType-Article-1
ObjectType-Feature-2
ISSN:1554-351X
1554-3528
DOI:10.3758/BRM.40.2.597