ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models

• Published in: arXiv.org
• Main Authors: Li, Chunyuan, Liu, Haotian, Li, Liunian Harold, Zhang, Pengchuan, Aneja, Jyoti, Yang, Jianwei, Jin, Ping, Hu, Houdong, Liu, Zicheng, Lee, Yong Jae, Gao, Jianfeng
• Format: Paper
• Language: English
• Published: Ithaca Cornell University Library, arXiv.org 13.10.2022
• Subjects: Benchmarks; Datasets; Image classification; Language; Mathematical models; Object recognition; Parameters; Toolkits; Visual tasks

Learning visual representations from natural language supervision has recently shown great promise in a number of pioneering works. In general, these language-augmented visual models demonstrate strong transferability to a variety of datasets and tasks. However, it remains challenging to evaluate th...