Rendering method and device for pen type listening and touching reproduction based on audio signals

• Main Authors: ZHAN YAN, CHEN JIAN, WANG QINGLONG, YAN XUEZHI, SUN XIAOYING, NAI WEIZHI
• Format: Patent
• Language: Chinese; English
• Published: 08.08.2023
• Subjects: ACOUSTICS; CALCULATING; COMPUTING; COUNTING; ELECTRIC DIGITAL DATA PROCESSING; MUSICAL INSTRUMENTS; PHYSICS; SPEECH ANALYSIS OR SYNTHESIS; SPEECH OR AUDIO CODING OR DECODING; SPEECH OR VOICE PROCESSING; SPEECH RECOGNITION

The invention provides a pen type listening and touching reproduction rendering method and device based on an audio signal, and belongs to the field of virtual reality and human-computer interaction. The method comprises the following steps: collecting audio signals of friction when interacting with real textures under different speeds and normal forces, preprocessing and carrying out discrete cosine transform, storing an obtained amplitude spectrum in a waveform table, and generating a voltage driving signal through inverse discrete cosine transform by acquiring the current speed and normal force in real time during rendering; the voltage driving signal presents a texture tactile feedback effect to an operator through the pen type vibration tactile feedback device, and the preprocessed audio signal itself can directly present a texture auditory feedback effect to the operator through the pen type auditory feedback device. The method has the advantages that the acquisition cost and the time frequency correlat