Evaluating exploratory visualization systems: A user study on how clustering-based visualization systems support information seeking from large document collections

Iterative, opportunistic and evolving visual sense-making has been an important research topic as it assists users in overcoming ever-increasing information overload. Exploratory visualization systems (EVSs) maximize the amount of information users can gain through learning and have been widely used...

Full description

Saved in:
Bibliographic Details
Published inInformation visualization Vol. 12; no. 1; pp. 25 - 43
Main Authors Liu, Yujie, Barlowe, Scott, Feng, Yaqin, Yang, Jing, Jiang, Min
Format Journal Article
LanguageEnglish
Published London, England SAGE Publications 01.01.2013
SAGE PUBLICATIONS, INC
Subjects
Algorithms
Clustering
Cognition & reasoning
Cognitive load
Collections
Decision making
Design
Digital archives
Human-computer interaction
Information overload
Information retrieval
Performance evaluation
Questionnaires
Semantics
Studies
Visualization
information visualization
cognition
Clustering
human–computer interaction
information seeking
Online AccessGet full text

Cover

More Information
Summary:Iterative, opportunistic and evolving visual sense-making has been an important research topic as it assists users in overcoming ever-increasing information overload. Exploratory visualization systems (EVSs) maximize the amount of information users can gain through learning and have been widely used in scientific discovery and decision-making contexts. Although many EVSs have been developed recently, there is a lack of general guidance on how to evaluate such systems. Researchers face challenges such as understanding the cognitive learning process supported by these systems. In this paper, we present a formal user study on Newdle, a clustering-based EVS for large news collections, shedding light on a general methodology for EVS evaluation. Our approach is built upon cognitive load theory, which takes the user as well as the system as the focus of evaluation. The carefully designed procedures allow us to thoroughly examine the user’s cognitive process as well as control the variability among human subjects. Through this study, we analyse how and why clustering-based EVSs benefit (or hinder) users in a variety of information-seeking tasks. We also summarize leverage points for designing clustering-based EVSs.
Bibliography:SourceType-Scholarly Journals-1
ObjectType-Feature-1
content type line 14
ISSN:1473-8716
1473-8724
DOI:10.1177/1473871612459995