Fluid: Scaling Autoregressive Text-to-image Generative Models with Continuous Tokens

• Published in: arXiv.org
• Main Authors: Fan, Lijie, Li, Tianhong, Qin, Siyang, Li, Yuanzhen, Chen, Sun, Rubinstein, Michael, Sun, Deqing, He, Kaiming, Tian, Yonglong
• Format: Paper
• Language: English
• Published: Ithaca Cornell University Library, arXiv.org 17.10.2024
• Subjects: Autoregressive models; Image processing; Large language models; Raster; Vision

Scaling up autoregressive models in vision has not proven as beneficial as in large language models. In this work, we investigate this scaling problem in the context of text-to-image generation, focusing on two critical factors: whether models use discrete or continuous tokens, and whether tokens ar...