Signal processing for haptic surface modeling: A review

• Published in: Signal processing. Image communication Vol. 138; p. 117338
• Main Authors: Stefani, Antonio Luigi, Bisagno, Niccolò, Rosani, Andrea, Conci, Nicola, De Natale, Francesco
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.10.2025
• Subjects: Haptic surface understanding; Signal processing; Virtual reality; Signal processing; Haptic surface understanding; Virtual reality
• ISSN: 0923-5965
• DOI: 10.1016/j.image.2025.117338

Haptic feedback has been integrated into Virtual and Augmented Reality, complementing acoustic and visual information and contributing to an all-round immersive experience in multiple fields, spanning from the medical domain to entertainment and gaming. Haptic technologies involve complex cross-disciplinary research that encompasses sensing, data representation, interactive rendering, perception, and quality of experience. The standard processing pipeline, consists of (I) sensing physical features in the real world using a transducer, (II) modeling and storing the collected information in some digital format, (III) communicating the information, and finally, (IV) rendering the haptic information through appropriate devices, thus producing a user experience (V) perceptually close to the original physical world. Among these areas, sensing, rendering and perception have been deeply investigated and are the subject of different comprehensive surveys available in the literature. Differently, research dealing with haptic surface modeling and data representation still lacks a comprehensive dissection. In this work, we aim at providing an overview on modeling and representation of haptic surfaces from a signal processing perspective, covering the aspects that lie in between haptic information acquisition on one side and rendering and perception on the other side. We analyze, categorize, and compare research papers that address the haptic surface modeling and data representation, pointing out existing gaps and possible research directions. [Display omitted] •We provide a comprehensive survey on haptic surface modeling and data representation.•We introduce an haptic modeling pipeline, mimicking the visual and audio domains.•We analyze and categorize existing research on haptic surface modeling techniques.•We review available datasets and applications for haptic surface modeling research.•We highlight gaps in haptic surface modeling and propose new research directions.