Overview of the ImageCLEF 2021: Multimedia Retrieval in Medical, Nature, Internet and Social Media Applications

• Published in: Experimental IR Meets Multilinguality, Multimodality, and Interaction pp. 345 - 370
• Main Authors: Ionescu, Bogdan, Müller, Henning, Péteri, Renaud, Abacha, Asma Ben, Sarrouti, Mourad, Demner-Fushman, Dina, Hasan, Sadid A., Kozlovski, Serge, Liauchuk, Vitali, Cid, Yashin Dicente, Kovalev, Vassili, Pelka, Obioma, de Herrera, Alba García Seco, Jacutprakart, Janadhip, Friedrich, Christoph M., Berari, Raul, Tauteanu, Andrei, Fichou, Dimitri, Brie, Paul, Dogariu, Mihai, Ştefan, Liviu Daniel, Constantin, Mihai Gabriel, Chamberlain, Jon, Campello, Antonio, Clark, Adrian, Oliver, Thomas A., Moustahfid, Hassan, Popescu, Adrian, Deshayes-Chossart, Jérôme
• Format: Book Chapter
• Language: English
• Published: Cham Springer International Publishing
• Series: Lecture Notes in Computer Science
• Subjects: Coral image segmentation and classification; ImageCLEF lab; Medical image classification; Prediction of effects of online image sharing; Recognition of website user interface components; Visual question answering and generation
• ISBN: 3030852504; 9783030852504
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/978-3-030-85251-1_23

This paper presents an overview of the ImageCLEF 2021 lab that was organized as part of the Conference and Labs of the Evaluation Forum – CLEF Labs 2021. ImageCLEF is an ongoing evaluation initiative (first run in 2003) that promotes the evaluation of technologies for annotation, indexing and retrieval of visual data with the aim of providing information access to large collections of images in various usage scenarios and domains. In 2021, the 19th edition of ImageCLEF runs four main tasks: (i) a medical task that groups three previous tasks, i.e., caption analysis, tuberculosis prediction, and medical visual question answering and question generation, (ii) a nature coral task about segmenting and labeling collections of coral reef images, (iii) an Internet task addressing the problems of identifying hand-drawn and digital user interface components, and (iv) a new social media aware task on estimating potential real-life effects of online image sharing. Despite the current pandemic situation, the benchmark campaign received a strong participation with over 38 groups submitting more than 250 runs.