The Joy of Co-Painting: Creative Human-AI Collaboration for Traceable Image-Generation Workflows

• Published in: IEEE Pacific Visualization Symposium pp. 318 - 328
• Main Authors: Satkunarajan, Jena, Koch, Steffen, Kurzhals, Kuno
• Format: Conference Proceeding
• Language: English
• Published: IEEE 22.04.2025
• Subjects: Adaptation models; Collaboration; Computational modeling; Faces; Human computer interaction; Human-centered computing; Iterative methods; Navigation; Optimization; Software; Visualization; Visualization techniques
• ISSN: 2165-8773
• DOI: 10.1109/PacificVis64226.2025.00038

Image-generative models have gained popularity over the last years with their ability to create realistic artwork. Realizing complex artworks with specific creative ideas often requires iterative optimization of specialized prompts, but may still result in inadequate images. The inclusion of reference images and adapting modelspecific parameters can help in steering the model and fostering the creative intent of the user. But by providing text prompts, initial images, and adapting model parameters, users face a vast design space for creating images. To navigate through this space, we propose a visualization approach that combines an interactive Provenance Graph, parameter visualizations, and high-dimensional embeddings. Our approach helps pursue multiple parallel creation paths, makes workflows traceable and parameter changes transparent, and facilitates the reporting of image editing steps. In addition to prompt formulation, we focus on targeted generation by probing parameters, image compositions, and editing details. We integrate the generative process into existing image editing software, enabling users to compose artwork in collaboration with the model. The presented approach is evaluated in a user experiment (\mathrm{n}=9) for generating artwork. The results show that users with different levels of experience can create targeted artwork but use different strategies when working with the Provenance Graph.