The Influences of a Knowledge Representation Tool on Searchers with Varying Cognitive Abilities

• Published in: ACM transactions on information systems Vol. 41; no. 1; pp. 1 - 35
• Main Authors: Choi, Bogeum, Arguello, Jaime, Capra, Robert, Ward, Austin R.
• Format: Journal Article
• Language: English
• Published: New York, NY ACM 25.02.2023
• Subjects: Information systems; Users and interactive retrieval; complex search; working memory capacity; switching ability; Knowledge representation
• ISSN: 1046-8188; 1558-2868
• DOI: 10.1145/3527661

While current systems are effective in helping searchers resolve simple information needs (e.g., fact-finding), they provide less support for searchers working on complex information-seeking tasks. Complex search tasks involve a wide range of (meta)cognitive activities, including goal-setting, organizing information, drawing inferences, monitoring progress, and revising mental models and search strategies. We report on a lab study (N = 32) that investigated the influences of a knowledge representation tool called the OrgBox, developed to support searchers with complex tasks. The OrgBox tool was integrated into a custom-built search system and allowed study participants to drag-and-drop textual passages into the tool, organize passages into logical groupings called “boxes”, and make notes on passages and boxes. The OrgBox was compared to a baseline tool (called the Bookmark) that allowed participants to save textual passages, but not organize them nor make notes. Knowledge representation tools such as the OrgBox may provide special benefits for users with different cognitive profiles. In this article, we explore two cognitive abilities: (1) working memory (WM) capacity and (2) switching (SW) ability. Participants in the study were asked to gather information on a complex subject and produce an outline for a hypothetical research article. We investigate the influences of the tool (OrgBox vs. Bookmark) and the participant’s working memory capacity and switching ability on three types of outcomes: (RQ1) search behaviors, (RQ2) post-task perceptions, and (RQ3) the quality of outlines produces by participants.