Check, Locate, Rectify: A Training-Free Layout Calibration System for Text- to- Image Generation

• Published in: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) pp. 6624 - 6634
• Main Authors: Gong, Biao, Huang, Siteng, Feng, Yutong, Zhang, Shiwei, Li, Yuyuan, Liu, Yu
• Format: Conference Proceeding
• Language: English
• Published: IEEE 16.06.2024
• Subjects: Benchmark testing; Diffusion models; Generators; Image synthesis; Layout; layout calibration; Pipelines; Text to image; text-to-image generation; training-free

Diffusion models have recently achieved remarkable progress in generating realistic images. However, chal-lenges remain in accurately understanding and synthesizing the layout requirements in the textual prompts. To align the generated image with layout instructions, we present a training-free layou...