ProGen2: Exploring the boundaries of protein language models

• Published in: Cell systems Vol. 14; no. 11; pp. 968 - 978.e3
• Main Authors: Nijkamp, Erik, Ruffolo, Jeffrey A., Weinstein, Eli N., Naik, Nikhil, Madani, Ali
• Format: Journal Article
• Language: English
• Published: United States Elsevier Inc 15.11.2023
• Subjects: Amino Acid Sequence; Artificial Intelligence; Databases, Factual; fitness prediction; Language; language modeling; protein design; Proteins - genetics; fitness prediction; language modeling; protein design

Attention-based models trained on protein sequences have demonstrated incredible success at classification and generation tasks relevant for artificial-intelligence-driven protein design. However, we lack a sufficient understanding of how very large-scale models and data play a role in effective pro...