Applying a novel visual-to-touch sensory substitution for studying tactile reference frames

• Published in: Scientific reports Vol. 11; no. 1; p. 10636
• Main Authors: Yizhar, Or, Buchs, Galit, Heimler, Benedetta, Friedman, Doron, Amedi, Amir
• Format: Journal Article
• Language: English
• Published: London Nature Publishing Group UK 20.05.2021; Nature Publishing Group; Nature Portfolio
• Subjects: 631/378/2629; 631/378/3917; 631/477; Adaptation; Alliances; Humanities and Social Sciences; Interdisciplinary aspects; Mapping; multidisciplinary; Posture; Proprioception; Science; Science (multidisciplinary); Vibrations
• ISSN: 2045-2322; 2045-2322
• DOI: 10.1038/s41598-021-90132-7

Perceiving the spatial location and physical dimensions of touched objects is crucial for goal-directed actions. To achieve this, our brain transforms skin-based coordinates into a reference frame by integrating visual and posture information. In the current study, we examine the role of posture in mapping tactile sensations to a visual image. We developed a new visual-to-touch sensory substitution device that transforms images into a sequence of vibrations on the arm. 52 blindfolded participants performed spatial recognition tasks in three different arm postures and had to switch postures between trial blocks. As participants were not told which side of the device is down and which is up, they could choose how to map its vertical axis in their responses. Contrary to previous findings, we show that new proprioceptive inputs can be overridden in mapping tactile sensations. We discuss the results within the context of the spatial task and the various sensory contributions to the process.