Cross-Modal Information Transfer and the Effect of Concurrent Task-Load

• Published in: Journal of experimental psychology. Learning, memory, and cognition Vol. 46; no. 1; pp. 104 - 116
• Main Author: Bahrami Balani, Alex
• Format: Journal Article
• Language: English
• Published: United States American Psychological Association 01.01.2020
• Subjects: Arithmetic; Auditory Stimuli; Cognitive Ability; Cognitive Processes; College Students; Cues; Reaction Time; Short Term Memory; Task Analysis; Transfer of Training; Verbal Stimuli; Visual Stimuli
• DOI: 10.1037/xlm0000715
• ISSN: 0278-7393

People's everyday lives offer plenty of situations where complex processing of information takes place, in which information needs to transfer across modalities to achieve a behavioral goal. The study examined the differential effects on object detection by a visual, verbal, or auditory cue held in working memory (WM), and the role of concurrent cognitive task-load on the final detection of that cue. Three experiments, all using same stimuli set but in different modalities, subjects held in memory a representation of a novel cue for a speeded detection in a search display at the end of each trial. The cue stimulus could be an image (visual), the name (verbal) or the sound (auditory) of a common animal or object. A mental arithmetic task was interleaved between the cue presentation and the cue detection. The results showed that information held in WM, either in verbal or auditory form, can efficiently transfer across modalities to complete a visual detection task for a representation of the initial WM-cue. The speed of detection was not affected by the cross-modal transfer of cue information but there was some detrimental effect on detection that could distinctively be attributed to the cognitive task-load. Together, these findings may provide some evidence for the role of the episodic buffer component of WM in integrating multimodal information originated from different sources, hence supporting the notion of the supramodal nature of WM. The results have been discussed in light of Baddeley's and Cowan's theoretical WM frameworks.