SoK: Memorization in General-Purpose Large Language Models

• Main Authors: Hartmann, Valentin, Suri, Anshuman, Bindschaedler, Vincent, Evans, David, Tople, Shruti, West, Robert
• Format: Journal Article
• Language: English
• Published: 24.10.2023
• Subjects: Computer Science - Computation and Language; Computer Science - Cryptography and Security; Computer Science - Learning

Large Language Models (LLMs) are advancing at a remarkable pace, with myriad applications under development. Unlike most earlier machine learning models, they are no longer built for one specific application but are designed to excel in a wide range of tasks. A major part of this success is due to t...