BP-GPT: Auditory Neural Decoding Using fMRI-prompted LLM

• Published in: Proceedings of the ... IEEE International Conference on Acoustics, Speech and Signal Processing (1998) pp. 1 - 5
• Main Authors: Chen, Xiaoyu, Du, Changde, Liu, Che, Wang, Yizhe, He, Huiguang
• Format: Conference Proceeding
• Language: English
• Published: IEEE 06.04.2025
• Subjects: brain-computer interface; Brain-computer interfaces; Codes; Decoding; fMRI; Functional magnetic resonance imaging; large language model; Large language models; Meteors; Neural decoding; Semantics; Signal processing; Space exploration; Speech processing

Decoding language information from brain signals represents a vital research area within brain-computer interfaces, particularly in the context of deciphering the semantic information from the fMRI signal. Although existing work uses LLM to achieve this goal, their method does not use an end-to-end...