Few-Shot Font Generation With Weakly Supervised Localized Representations

• Published in: IEEE transactions on pattern analysis and machine intelligence Vol. 46; no. 3; pp. 1479 - 1495
• Main Authors: Park, Song, Chun, Sanghyuk, Cha, Junbum, Lee, Bado, Shim, Hyunjung
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.03.2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: computer vision; Data models; Design; Factorization; Feature extraction; Few-shot font generation; few-shot generation; font generation; Fonts; image-to-image translation; Libraries; Representations; Skeleton; Source code; Task analysis; Training; Visualization
• ISSN: 0162-8828; 1939-3539; 2160-9292
• DOI: 10.1109/TPAMI.2022.3196675

Automatic few-shot font generation aims to solve a well-defined, real-world problem because manual font designs are expensive and sensitive to the expertise of designers. Existing methods learn to disentangle style and content elements by developing a universal style representation for each font style. However, this approach limits the model in representing diverse local styles because it is unsuitable for complicated letter systems. For example, Chinese characters consist of a varying number of components (often called "radical") with a highly complex structure. In this paper, we propose a novel font generation method that learns localized styles, namely component-wise style representations, instead of universal styles. The proposed style representations enable synthesizing complex local details in text designs. However, learning component-wise styles solely from a few reference glyphs is infeasible when a target script has a large number of components, for example, over 200 for Chinese. To reduce the number of required reference glyphs, we represent component-wise styles by a product of component and style factors inspired by low-rank matrix factorization. Owing to the combination of strong representation and a compact factorization strategy, our method shows remarkably better few-shot font generation results (with only eight reference glyphs) than other state-of-the-art methods. Moreover, strong locality supervision was not utilized, such as the location of each component, skeleton, or strokes. The source code is available at https://github.com/clovaai/lffont .