BioGPT: generative pre-trained transformer for biomedical text generation and mining

• Published in: Briefings in bioinformatics Vol. 23; no. 6
• Main Authors: Luo, Renqian, Sun, Liai, Xia, Yingce, Qin, Tao, Zhang, Sheng, Poon, Hoifung, Liu, Tie-Yan
• Format: Journal Article
• Language: English
• Published: England 19.11.2022
• Subjects: Data Mining; Natural Language Processing; generative pre-trained language model; text mining; biomedical literature; text generation

Pre-trained language models have attracted increasing attention in the biomedical domain, inspired by their great success in the general natural language domain. Among the two main branches of pre-trained language models in the general language domain, i.e. BERT (and its variants) and GPT (and its v...