Visual and Textual Prior Guided Mask Assemble for Few-Shot Segmentation and Beyond

• Published in: IEEE transactions on multimedia Vol. 26; pp. 7197 - 7209
• Main Authors: Chen, Shuai, Meng, Fanman, Zhang, Runtong, Qiu, Heqian, Li, Hongliang, Wu, Qingbo, Xu, Linfeng
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Adaptation models; Annotations; any-shot; Assembling; class-agnostic; CLIP; Few-shot segmentation; Image segmentation; Prototypes; Task analysis; Training; Visualization; zero-shot

Few-shot segmentation (FSS) aims to segment the novel class with a few annotated images. Due to CLIP's advantages of aligning visual and textual information, the integration of CLIP can enhance the generalization ability of FSS model. However, even with the CLIP model, the existing CLIP-based F...